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AN EXPERIMENT WAS CONDUCTED TO INVESTIGATE STUDENTS 1 
SENSE OF CONTROL OVER THEIR OWN DESTINIES, THE EFFECTS OF 
SIMULATION GAMES ON THESE CONTROL BELIEFS, AND THE 
RELATIONSHIP OF THESE ISSUES TO THE RACIAL COMPOSITION OF A 
SCHOOL. IT WAS HYPOTHESIZED THAT INDIVIDUALS LACKING A SENSE 
OF CONTROL HAD HAD LIMITED EXPERIENCE WITH SITUATIONS WHICH 
COULD BE AFFEC TED^BlT THE I R OWN ACTIONS, AND THAT SIMULATION 
GAMES WHICH PROVIDED THIS EXPERIENCE CAN GIVE STUDENTS THE 
SENSE OF SUCH CONTROL. THE EXPERIMENTAL SUBJECTS WERE 
MIDDLE-ABILITY STUDENTS IN THREE HIGH SCHOOLS, AN ALL-NEGRO, 
AN INTEGRATED, AND A PREDOMINANTLY WHITE ONE. IN EACH SCHOOL 



PAIRS OF CLASSES PARTICIPATED IN TWO SIMULATION GAMES 
INVOLVING MATERIALS ON (1 > GOVERNMENT LEGISLATION AND (2) 
"LIFE CAREERS" DECISIONS. MATCHED CONTROL GROUP CLASSES 
COVERED THE SAME MATERIAL USING CONVENTIONAL READING MATERIAL 
AND CLASS DISCUSSIONS. QUESTIONNAIRES WERE ADMINISTERED TO 
STUDENTS BEFORE AND AFTER THE GAMES TO ASSESS THEIR CONTROL 
BELIEFS. CATA WERE ALSO GATHERED ON STUDENTS' BACKGROUND, 
RACE, AND SCHOOL RECORD. THE FINDINGS SUGGESTED THAT ALTHOUGH 
THE GAMES DO NOT PRODUCE FACTUAL LEARNING OR A SENSE OF 
CONTROL "OF A GLOBAL SORT," THEY DO SEEM TO AFFECT SUCH 
CONCEPTS AS PLANNING AHEAD, FUTURE, LEARNING, AND SELF. THE 
INTEGRATED NEGRO STUDENTS PERFORMED NO DIFFERENTLY FROM 
"THOSE IN THEIR RESPECTIVE GROUPS." THE FINDINGS OF THE STUDY 
WERE FELT TO BE GENERALLY INCONSISTENT AND TO INDICATE THAT 
CONTENT LEARNING AND CONTROL BELIEFS ARE RELATED TO A COMPLEX 
SET OF VARIABLES. (LB) 
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INTRODUCTION 






The objective of this research was to combine an analysis of the 
concept of control of destiny with an analysis of the learning effects 
of games with simulated environments in order to gain an understanding 
of the ways in which this attitudinal variable and this learning technique 
may affect each other. The research had three specific objectives: 

1. to analyze the meaning and effects of control beliefs 5 

2. to investigate the possible effects of exposure to simulation 
games on control beliefs; 

3. to relate these issues to the context of de-facto segregated 
vs. non-segregated schools. 

A growing body of theory and evidence supports the view that be- 
havior in general and learning in particular is strongly affected by 
the individual's sense of "control of destiny" — that is, the extent 
to \diich he believes that his destiny is controlled by himself rather 
than by luck or other arbitrary features of his environment (Rotter, 1966; 
Seeman, 1966). More recently, impressive evidence was presented by 
Coleman and Campbell in their large-scale survey of education in the 
United States (Coleman & Campbell, 1966). This survey was intended inter 
alia to discover,! oh a large national sample, the factors which make for 
high versus low achievement in school. Among the major findings were 
those pertaining to a variable defined as "belief in control of environ- 
ment": 

— that the extent of this belief was a major differentiating 
factor between white and Negro school children (at grades 
one, three, six, nine, and twelve); 

— that this belief is the best predictor of school achievement 
for Negro children and the second best predictor for white 
children; this finding holds when other relevant variables, 
such as family background and characteristics of the school 
and faculty, are held constant ; 



1 



— that the sero- order correlation of this belief with 
achievement, is as high as the correlation of achieve- 
ment with ability measures. 

Thus much of the ineffective behavior associated with socio -cultural 
background may be rooted in a low sense of control rather than in the lack 
of abilities and drive implied by the term "cultural deprivation," and 
low sense of control may in turn hamper actual learning — including the 
learning of control beliefs. 

The antecedents of sense of control are not known, nor have effective 
ways to increase this sense been established. One possibility is that a 
low sense of control derives from insufficient experience with situations 
characterized by dear actual contingencies — that is, from a past where 
outcomes in fact have not been highly contingent on the actor's own be- 
havior or where the contingencies have been too complex for easy perception 
(on the importance of the nature of contingencies in childhood, see Gewirtz, 
1961). ' 

Our general hypothesis in this study is that simulation games may have 
a general impact upon this very important attitudinal variable, in addition 
to teaching whatever knowledge and skills are contained in a specific game. 
Our hypothesis is beised upon the conception of deprivation, formulated in 
the previous paragraph, as a more or less accurate definition of the in- 
dividual's actual real-life situation — that is, that absence of sense 
of control is more likely among those who have in fact had less experience 
with situations where they either could control the outcomes or could at 
least see how their own actions were related to the outcomes. If this is 
an accurate conception of the variable (data relating to this point will 
be presented in the first section of the data analysis), extended experience 
in simulated environments might remedy the deficiency. Our hypothesis is 
also based upon empirical clues obtained from our field testing of s imul ation 




- games during the past five years (e.g. , Boocock, 1963 5 Boocock and Coleman, 
1966), although there is no systematic body of evidence that games can 
have a positive effect upon control beliefs. 

In this paper, we shall be working toward formulation of a model 
which will describe the components of sense of control of destiny and the 
way it affects and is affected both by characteristics of the individuals 
background and environment and by experience in simulation games as com- 
pared with more conventional learning situations. 

Research Design 

Figure A shows the design of the experiment conducted in three 
Baltimore schools in March, 1967, including the sample used and the 
sequence of activities in the experimental and control classes. 

As Figure A shows, the schools were selected to represent different 
racial composition. Within each school, our objective was to select pairs 
of classes: 



—in social studies classes which were closest in content to the 
content of the games to be used as the experimental treatment 
(so that the activities in both experimental and control classes 
would seem as far a possible a natural part or extension of the 
course); 



- - of the same ability level . In each school Wc a>sA.eu. xuj. pbuucuuo 
of "average” or middle level ability for that school i.e., 
we did not want classes of the brightest youngsters in that school 
nor classes for slow learners or other problem students. Of course, 
this did not mean that the mean ability level was the same in the 
three different schools used. 

All classes in Schools A and C were 11 th grade American history (which in- 
cludes a unit on Congress, and usually some kind of work on the labor market 
or occupational opportunities in America). At School B, because of scheduling 
problems, teaching loads, and very tight use of classroom space, we could 
get only one pair of lQth grade classes that met our other criteria. Since 



— taught by the same teacher (and by a teacher 
minimum level of interest in the project); 
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the teacher in this case was particularly interested in the project and 
the school did have the racial composition we wanted, we decided to com- 
promise here rather than spend the time required to find a school that 
more exactly matched our ideal research design. Ideally, of course, one 
wo ul d have one teacher teaching all four classes in a given school (tp 
control for teaching style and personal, characteristics of individual 
teachers). However, since few schools have as many as four classes of any 

o 

single course, at the same ability level or track, and such classes would 
not in any case he assigned to a single teacher, our best solution seemed 
to be to make certain that each of our teachers taught a pair of classes, 
one experimental and one control, matched on same subject and ability 
level. 

Comparison of the aggregate statistics for the three school sub- 
samples, shown in Table 1, indicates that each sub-sample does have one 
or more characteristics which distinguish it from the others. In School 
A, as compared with the other two, a majority of respondents live ip, homes 
in which one or both parents is absent, although it does not contain ary 
more family breadwinners at the bottom of the occupational ladder (un- 
employed or in unskilled jobs), and fewer parents are non-high school graduates 
than in School B, a school located in a working class neighborhood with 
unusually high residential stability. Consistent with the looser family 
structure characteristic of School A, relatively high proportions of the 
respondents do not knpw how much education their parents had. At the 
other extreme is School C, an academically oriented high school in a middle* 
class suburban area of Baltimore, which contains all but one of the 
parent college graduates in the total sample and in which a majority of 
the heads of households have white collar or professional jobs. 

Note also that in Schools B and C, the proportion of Negro respondents 
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TABLE 1. Background Characteristics of Respondents, By School 



°L of Respondents: 


A 

? 


SCHOOL 

X t 


C 

% 


Who are male 


37 


54 


31 


Who are Negro 


100 


25 


4 


Who live with both parents 


45 


82 


86 


Whose father (or male guardian) 

- did not graduate from high school 


39 


55 


33 


- graduated from college 


3 


0 


20 


- don’t know 


32 


25 


12 


Whose mother (or female guardian) 


- did not graduate from high school 


47 


70 


33 


- graduated from college 


0 


0 


10 


- don’t know 


24 


18 


2 


Whose father (or male guardian) 

- is unemployed or works at 
unskilled labor 


42 


59 


16 


- holds a white collar or 
professional job 


21 


16 


6l 


Total Respondents 


(77) 


(45) 


(115) 
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is smaller than the proportion of Negro students in the whole school. 

Since we asked in Q&ch case for classes in the middle ability track for 
that school, the underrepresentation of Negroes in our sample probably 
reflects the tendency for di sporport ionat e number of Negro students to 
be assigned to lower ability classes in integrated schools! 

Experimental and Control Group "Treatments” 

All experimental classes participated in two simulation games de- 
veloped at the Department of Social Relations, Johns Hopkins University: 

(1) the legislature level of "The Game of Democracy" (copyright 1965 by 
James S. Coleman); and (2) "Life Career" (copyright 1965 by Sarane S. 
Boocock). The first game was played during three consecutive class periods, 
the second for the following five days. Note that the games vary not only- 
in length but also in th* extent to which the content is directly applicable 
to the players* own lives, In "Legislature," these students took roles 
which few if any of them would ever actually assume in real life (and which 
would be in the distant future for the few who might pursue a political 
career). On the other hand* Life Career simulates situations and decisions 
which most of these student? will have to make in their own lives within 
the next few years. 

During the same eight -day period, all control classes read and 
discussed materials covering the same content as the two games used in 
the experimental classes. The readings were selected from textbooks and 
other materials obtained from the Baltimore Department of Education. 

That is, they represent a sample of reading materials currently being used 
in Baltimore social studies courses. 

Preparation of Teachers 

All of the teachers participating in the experiment were prepared 
in the following sequence of activities: 

? 






1) About a month before the beginning of the experiment, the five 
teachers attended a two -hour introductory work session at Johns Hopkins, 
at which members of the research staff: 

— explained the general research design; 

— described how experimental and control groups were designated 
( randomly except in the case of one teacher who insisted upon 
making the choice herself); 

— described gape playing materials; 

-- presented the two games actual playing materials. The teachers 
took sample materials away with them to go over on their own; 

— reviewed the reading materials for the control classes. We made 
some changes in thi reading assignments based upon suggestions by 
the teachers . 

2) The teachers attended one or both of two one-day workshops conducted 
by members of the research staff at a local school as a means of introducing 
the s imulat ion technique to a cross section of Baltimore teachers, counselors 
and administrators. (These workshops had fortunately been scheduled sq that 
they fell on the two Saturdays just before the beginning of the experiment.) 
The workshops included some general orientation to the simulation gami n g 
technique, demonstrations of seven games (including Legislature and Life 
Career) by Baltimore high school students, and participation in one or two 
of the games demonstrated. 

3) During the week before the experiment began, members of the re- 



search staff visited each of the three school for additional meetings 
with the teachers. These lasted from l/2 hour to two hours depending 
upon the amount of review of plans that was required and the number of 
questions and/or amount of anxiety individual teachers had about the ex- 
periment. > ; 

4) Questionnaires, materials for each game, and readings were de- 
livered the day before they were scheduled for use and picked up after 
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they were completed op used* Afc this time , we checked with the teachers 
about how the experiment was going and answered questions, but we did not 



go into the classes while the experiment was in process. 

Responses from the teachers themselves and the data on the effects 
of the experiment indicate that our preparation of teachers was not 



adequate. Our interpretation of the effects of inadequate teacher pre- 
paration upon the results of the experiment and our plans for supplement- 
ing it in future research will be discussed in the final section of this 
report, but we will only underscore here that this seems to us to be the 
weakest component of the entire experiment and to go far to explaining 
the relatively weak effects of the games in areas where we had predicted 
a stronger one. 

Date Collection 



Appendix A contains a copy of the data collection instrument given 
before and after the experimental and control group "treatments." The 
questionnaire consists of sets of items which have been used in our previous 
field work, which have been revised from previous questionnaires, or ' 
which we have since discovered which seemed particularly relevant to the 



variables we were attempting to measure. 

The first eight pages consist of a set of semantic differential 
scales which are a device for measuring definitions of concepts basic 
to the game experiences. Following the semantic differential, items #1- 
13 are a set of previously tested items some oriented toward content 
knowledge and others toward sense of control with respect to the Life 
Career game. Items #14-24, adapted from a test used at the Pennsylvania 
Advancement School* is designed to measure whether players can apply 



* An experimental residential school for underachieving boys, which has 
do ne extensive experimentation with Hopkins and other simulation games 
as a technique for teaching underachievers. For a description of this 
research program and analysis of data from one such experiment, see 
Farron, 1967 . 



9 



the principles learned in the Life Career game to a slightly different 
hypothetical life situation. Items 25-35 measure knowledge and sense 
of control with respect to political action. Items 36-41 are the six 
control of destiny items used in the Coleman* Campbell et al. study* 
Eguality of Educational Opportunity . Items 42-62 are selected from the 
34-item IAR (intellectual achievement responsibility) scale for children* 
as used by Crandall et al. (1965). This seemed a particularly useful 
instrument since it contained items measuring children* s feelings of 
control over the outcomes of play and games as well as regular school 
work. The last two pages* given only on the after questionnaire* ask for 
background information. 

In addition to the questionnaire data* all respondents* class ranking, 
IQ score* most recent grade in this class, and. race were obtained from 
the teacher or from school records. 

As Figure A shows, while all classes were given the post-game 
quest ionnaire* one of the pairs of classes in Schools A and C (selected 
randomly) did not take the pre-test* which allowed us to examine a 
possible test effect of the first questionnaire. 

The Ideal Model* 

The basic design of our research is the Solomon Four-Group Design* 
When administered properly, this design enables one to measure not only 
the main and interaction effects of testing* but also the main effects of 
maturation or history. History refers to events other than experimental 
treatment which may influence posttest performance. In running the 

1 

exper imen t contemporaneously for all groups* we have better control over 
the effects of history. 



* We are grateful to the assistance given us by Julian Stanley in 
formulating this model. 
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The testing itself may have an effect in several ways. The pre 
test may cue the subjects to be alert for the information discussed in 
a later appropriate situation. This appropriate situation soon arises 
in the form of the experiment. Another problem is simply carry-over of 
experience on pre-test tasks to the posttest. By use of posttest -only 
groups it is possible to analyze the main and interaction effects of 
pre-testing. 

Although the basic model of the Four-Group Design was followed here, 
one critical requirement is missing. Randomization was not employed in 
assigning persons to groups. Whenever experimental and control groups 
do not have sample equivalence one has a compromise design, not a true 
experiment. Without randomization, then ’’other" unidentifiable effects 
may occur due to differences in the composition of groups. 

Randomization is also important for the use of certain powerful 
statistical tests complimentary to the design, such as analysis of 
variance and covariance. The procedure also assists in assigning equal 
numbers of subjects to groups, another desirable aid for data analysis. 
Because we lacked such control over assignment, several of our groups 
are considerably larger than the others (notably at School C). 

Although our design approximates the Four-Group design, we decided 
aga inst using the more elegant statistical procedures. Although the 
experimental and control groups within each school are very similar on 
most background variables, there are differences in the sex distributions. 
(Females predominate in the experimental groups; males in the controls.) 
Knowing that sex has been demonstrated to be an important variable in 
game-playing (Vinacke, 1959, Joseph and Willis, 1963) and in conventional 
classroom achievement (Lavin, 1965), it appeared unwise to assume 
r andomi zation* Also, such procedures are better applied when there is 
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more certain knowledge about the reliability of indicators then we had 
available. 

As a result the techniques for analysis form are more wieldy. We 
have chosen to depend upon the use of multiple indicators and look for 
consistency across results. Decisions concerning the presence or absence 

t 

of a relationship have been made by inspection rather than by significance 
tests. We have included as compete a selection of the data as appears 
feasible so that the reader can judge for himself whether our conclusions 
are justified. 
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1. The Meaning and Effects of Control Beliefs 



A major finding of the Coleman et al. report. Equality of Edu- 
cational Opportunity is the importance of a sense of control of environ- 
ment for subsequent in-school achievement. In this section, we shall 
try to extend our understanding of the nature of this attitudinal vari- 
able by two kinds of analysis: 



— treating control belief as a dependent variable, we shall 
study the degree to which differential attitudes can be ex- 
plained by a set of background factors; 



— treating control belief as an independent variable, we shall 
see whether it helps to explain differences in the information 
or skills students have at the beginning of the experiment 
(effects of control belief on actual performance in simulation 
g ame s and the conventional classroom situation will be dis- 
cussed in the next section (2) of this report). 

Another, related finding of the Coleman report concerns the relation- 
ship between minority vs. majority group membership and control belief. 



For children from advantaged groups, achievement or lack 
of it appears closely related to their self-concept ; what 
they believe about themselves. For children from disad- 
vantaged groups, achievement or lack of achievement appears 
closely related to what they believe about their environ- 
ment: whether they believe the environment T *rill respond to 
reasonable efforts, or whether they believe xb is instead 

merely random or immovable. In different words, it appears, ^ 

that children from advantaged groups assume that the environ- 
ment will respond if they are able enough to affect it; 
children from disadvantaged groups do not make this assumption, 
but in many cases assume that nothing they can do can affect 
the environment — it will give benefits or withhold them 
but not as a consequence of their own action ( Equality of - 
Educational Opportunity, pp. 320-1). 

As suggested earlier, for the minority group child, the belief that the 



environment; is capricious may well be an accurate reflection of his op- 
portunities to alter or control situations in a favorable direction. 

While our sample was not intended to be representative of the Baltimore 



high school population, it can be considered as a kind of miniature re- 
plication of the Coleman thesis and an opportunity to study in somewhat 
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more detail, in a special sample, the components of this important variable. 
Or to look at it another way, the Coleman national sample can be used as 
a basis of comparison for our sample, as a means of identifying the ex- 
tent and direction in which our respondents deviate from a national sample 
of age peers. 

The first part of our analysis then will deal with the effects of the 
ascribed characteristics of race, socio-economic position, and sex upon 
sense of control of environment as measured in this Coleman report.* 

Al. Control Belief as a Dependent Variable . There are three general 
trends with respect to the response characteristics of the national sample 
on the control items. Two findings were as predicted, (l) White re- 
spondents have a greater sense of control than Negro. (2) The higher 
the social status of the respondent, the greater the sense of control. 

The third finding was somewhat surprising: females have a greater sense of 
control than males. In general these relationships are additive. (The 
data is not presented here.) 

Our data present some interesting deviations from the national 
sample. In Table 3 the measures of effect for each variable are presented. 
(Epsilon is simply a measure of the percentage difference in sense of 
control between the two relevant classifications, e.g., white -Negro, 
middle class -lower class, ** male- female. ) Most notably, on two items 
in our sample the Negroes have a much greater sense of control than 

* Items 36-4l in the questionnaire. Appendix A. Analysis of the 
sources of control beliefs, including the same ascribed char- 
acteristics to be discussed here, in the national probability 
sampling of twelfth graders, is currently being performed by 
Clarice Stoll. 

** For this rough comparison, all respondents whose .father or male 
guardian was employed in a skilled labor or higher occupation 
were classified as middle class. 
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TABLE 3. Effects of Background Items Upon Control 


Epsilons 












a 

Race 


b 

Class 


c 

Sex 






1 *• 

i 

t 

: 37. 


"Luck": Good luck is more 
important than hard work for 
success. (Disagree) 


.01 


-.06 


.02 






"Others stop": Every time I 
try to get ahead, something 
or somebody stops me. (Disagree) 


.04 


.07 


-.15 






• 

00 

on 


"Own fault": If a person is not 
successful in life, it is his 
own fault. (Agree) 


-.17 


-.05 


.11 


- 




39. 


"No chance": People like me don’t 
have much of a chance to be 
successful in life. (Disagree) 


-.05 


.03 


-.09 






4o. 


"Accept condition": People who 
accept their condition in life 
are happier than those who try 
to change things. (Disagree) 


-.21 


.13 


.11 






4l. 


"Right job": Even with a good 
education. I’ll have a hard time 


.04 


-.02 


-.05 


> 





gecting the right kind of job. 
(Disagree) 



a A positive epsilon means whites are higher than Negroes. 

b A positive epsilon means middle-class respondents are higher than lower-class, 
c A positive epsilon means males are higher than females. 
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Whites (38, 40) . Also, the items for which in our sample little racial 
differentiation appears are the very ones in the national sample which 
show a definite racial effect . 

With respect to class, there is a fair similarity between the 
differences appearing in our sample and those in the national. Middle- 
class respondents exhibit a greater sense of control in both samples on 
items 40 and 37, but there is little class differentiation for other 



items. 



Our sample again deviates with regards to sex. On two items, 38 
and 40, the mal es exhibit a greater sense of control than the females. 

On only two of the six items are the differences clearly in the direction 
of the national trend, with females having a greater sense of control 
than males. 

There is more to the effects of race, class, and sex on sense of 
control than Table 3 indicates. First, race and class are correlated; 
hence one must be able to examine the possibility that the apparent ef- 
fects of one variable are not actually reflections of the other. Secondly, 
individuals hold ascribed characteristics in combination, and present a 
patterning of attributes to others. The saliency of a particular attribute 
may vary within situations. (For example, the race of an apartment hunter 
is more salient than his sex from the renter* s point of view.) If our 
simple propositions are correct, one is faced with the possibility that 
certain patternings or combinations of attributes present a series of 
experiences such that there is an interaction effect in the development 
of a sense of control. Some illustrative questions: Could the fact of 
being middle class and white compensate for the limitations of being 
female? Or, should we expect that lower-class Negro females will not 
only have the least sense of control over environment, but that the pro- 
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portion of such respondents with a low sense of self-destiny will he 
greater than predicted by use of an additive model? 

Our samplers size precluded a classification of respondents on all 
three attributes simultaneously. Tables 4 through 6 show the proportion 
who respond positively to control items , holding constant two of the 
three attributes at a time. There are some conspicuous deviations be- 
tween the responses of certain subgroups in our sample from those of the 
national sample. 

The first table shows an interactive relationship between class and 
race. Among Negroes, lower-class respondents express higher sense of 
control than middle-class respondents on five out of the six items, while 
the relationship is in the reverse direction among whites (the per cents 
are higher for middle class than lower-class whites on all items). Racial 
comparisons with class held constant show that among lower-class respondents, 
Negro per cents are higher than whites on five out of six items, while the 
reverse is true in the middle-class group. Moreover, on all but one item 
lower-class Negroes exhibit greater sense of control than lower-class whites 
or middle-class Negroes. In the national sample whites have a greater 
sense of control than Negroes, regardless of class, on these four items. 
Secondly, unlike the national sample, girls show a consistently greater 
sense of control than boys on only one item (37). 

Very likely the selection procedure accounts for some of the unusual 
characteristics of the sample. As mentioned previously, only middle- 
track students were included in the study. As a result, those Negroes 
in the sample are the highest Negroes in the schools by academic status. 

It should not be surprising then to see that the lower-class Negro re- 
spondents have a high degree of control, having achieved an unusually 
high level of success relative to others in their position. It is not 
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TABLE! 4. Sense of Control by Class and Race 



CLASS: Lower Middle 



RACE: 


Negro 


White 


Negro 


White 


$ who give positive answer to item: 


(21) 


(29) 


(19) 


(56) 


36. Luck 


48 


31 


21 


36 


37. Others stop 


71 


59 


58 


77 


38. Own fault 


71 


4i 


58 


46 


39* No chance 


57 


17 


21 


43 


40. Accept condition 


50 


55 


58 


69 


4l. Right job 


76 


62 


47 


73 
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TABLE 6. Sense of Control by Sex and Class 





Female 




Male 




Lower 


Middle. 


Lower 


Middle 


io who give positive answer to item: 


(sM 

Jv 


m 


(26) 


(26) 


36. Luck 


42 


31 


35 


31 


37. Others stop 


67 


79 


62 


58 


39. No chance 


38 


4o 


31 


31 


40. Accept condition 


43 


64 


62 


68 


4l. Right job 


67 


70 


69 


58 
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apparent though why the sex differences in our sample vary from those 



One unintended advantage of the atypicality of our sample is that 
there are students with a high degree of control at all three schools. 

If our sample had reflected trends in the national sample, with Negroes 
having a low sense of control compared to whites, then there would be 
too little variation among respondents within the schools to study the 
effects of pre -experimental level of control on learning independently 
of the school. 

Thus sense of control does seem to be related to background factors 
such as race, SES, and sex, but in more complex ways than suggested by 
the initial reporting of the Coleman findings. 

A2. Pre-Test Knowledge . Turning then to control beliefs as an in- 
dependent variable, we shall examine the effects which this variable, and 
the background variables just discussed in relation to control beliefs, 
have upon responses to the pre-test questionnaire. That is, if certain 
types of students enter the experimental situation more knowledgeable or 
with different feelings about the content of one or both of the simulation 
^ games, we would expect different patterns of reaction to and performance 

in the game. 

In addition to finding out whether certain subgroups of the sample 
have an initial level of knowledge or set of attitudes different from the 
sample as a whole, study of pre-test responses are useful in other ways. 
First, the over-all distribution of responses is necessary for selecting 
items on idlieh we should expect some change to occur. If most of the 
respondents are knowledgeable with respect to the material which is being 



I in the national sample, although this may be related in some 1 

l the underrepresentation of boys in two of the three school sa 1 




Table l). 
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presented in the experimental treatment, then we can hardly expect any 
learning to occur* Secondly, it is useful to compare the responses to 
some of the statements to results of similar research on adolescents* 

This technique helps us again to estimate the ways in which our particular 
sample of adolescents is possibly unique, or atypical* Any generalizations 
from this sample to other samples of teenagers must be made in light of 
such peculiarities* 

In order to simplify the presentation of findings, composite scales, 
combining responses to sets of related items, will be used in most of the 
following tables* These scales are either taken from the literature (e*g f , 
the I scales) or constructed from items found in our previous research to . 
be interrelated in meaningful ways* Data on individual items will be pre- 
sented or described only when they seem to clarify our findings in some 
important way or when they differ markedly from the general trends reported* 

The five composite indices which will be used in the following dis- 
cussions are: 

1) Career Knowledge Scale, a measure of the kinds of factual in- 
formation which could be learned from the Life Career game (and 
the control group readings)* A respondent's score shows the 
number of the following questionnaire items which he answered 
correctly: 2, 5, 6, 7, 8, 9, 11, 12, 13, 15, 16, and 17; 

2 ) Legislature Knowledge Scale, a similar measure covering the 
content of the Legislature game* It is based upon questionnaire 
items 25 , 27 , 29 , 30 , 31 * and 32 ; 

3) Coleman Control Scale, which indicates how many of the six 
individual control of environment items from the Coleman 
study were answered in the direction of belief in control* 

4) Positive I Scale, the number of items from the Crandall at 
al* scale (a) on which the respondent attributed his success 
to his own efforts (b) from among those which were worded in 
a positive way (e.g*, doing well on a test, winning a game, 
solving a puzzle quickly)* These are questionnaire items 42, 

44, ^5, 47, 49, 52, 54, 56, 59, 60, and 62; 

5) Negative I Scale, the negative mirror image of scale (4)* It 
measures the number of items from the Crandall scale (a) on 
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which the respondent attributed his failure to his own lack 
of effort (h) from among those which were worded in a negative 
way (e.g., doing poorly on a test, losing a game, failing to 
solve a puzzle). These are questionnaire items 43, ^6, 48, 

50, 51, 53, 55, 57, 58 , 6l, and 63 , each of which represents 
the opposite, negative side of a pair item in the Positive 
X Scale* (For more details on this scale and its previous use 
in research, see Crandall et al«, 1965* For a discussion of 
the interrelationships among the three control scales for this 
sample, see Appendix B.) 




The effects of sense of control and family background, with school 
also controlled, upon career and legislature pre-test knowledge are shown 
in Table 7, which is a summary table of a regression analysis of the 



sources of pre-test knowledge. 



The first point to be noted is that the proportion of variance in 
pre-test knowledge scores explained by these three types of factors varies 



for the two types of knowledge, in patterns which are consistent with the 
nature of the subject matter of the two games (and sets of readings). As 
noted earlier, the Life Career game involves problems and decisions which 
touch these students directly — all of them will have to make career plans 
in the near future, even if this only means deciding to leave everything 
about one's career to fate. Moreover, the extent to which they have ob- 
served successful career planning and patterns, among their families, older 
friends, and other persons is in large part a function of the characteristics 
of their social environment (the number of persons at various educational 
and occupational levels, the type of family life and leisure time activities 

■ i 

they see around them, and so on). Thus it makes sense that background, 
in particular social class, is the best predictor of career knowledge, that 

those who are most likely to be around people of higher educational, oc- j 

- ’ 1 

cupational, and social status would know more about its requirements and J 

advantages . j 

Likewise the smaller but substantial contribution of sense of control | 

to career knowledge is reasonable. Those who believe in their own power to | 









TABLE 7 . Proportion of Variance in Pre-Test Knowledge by Sense of Control, 

Background Variables and School 



Career Knowledge Legislature Knowledge 



Control Belief: 


4.53 




.88 




Positive I 




2.13 




.72 


Negative I 




.04 




.12 


Coleman 




2.36 




.04 


Background: 


8.64 




2.68 




Sex 




.06 




H 

O 

• 


Class 




8.46 




1.53 


Race 




.04 




VO 

0 

• 


Grade Average 




00 

0 

• 




1.08 


School: 


2.66 




7*64 




A 




.53 




.04 


B 




2.13 




7.60 


C 










Over-All 


15.83 




11.20 
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control their own destiny would presumably be more involved in the type 
of career planning the game is designed to provide. 

By contrast with the Life Career game, the Legislature game (and 
the questionnaire items designed to test knowledge of its content) deals 
with processes and decisions with Which few students, or their families, 
are directly involved. Here the only important explanatory variable is 
school, in particular attending School B. This was apparently a case of 
recent classroom learning on this topic. School grade average, while it 
does not account for a large portion of the variation, is more important 
in connection with legislature than career knowledge. Conversely, the 
family background proportion is much lower for legislative than career 
knowledge, probably reflecting the relative lack of experience of most 
people with politics. Sense of control accounts for almost none of the 
variance. If, as we have formulated, sense of control comes partly from 
real-life experience in which one sees one's own actions as having some 
effect on outcomes, then the well -documented lack of direct participation 
of most adolescents in any kind of political activity would make it un- 
likely that general sense of control would contribute much to political 
knowledge. 

While Table 7 thus suggests that knowledge of the type which the 
two games are designed to communicate is gained through rather different 
learning paths, it should also be noted that in neither case do the back- 
ground factors of sex and race account for more than a minute portion Of 
the total knowledge score. 

Analysis of the individual items comprising some of our composite 
scale provided some further clues about pre-test knowledge of the subject 
matter of the simulations. In connection with legislative knowledge, this 
more detailed analysis revealed no additional differences among types 
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of respondents in responses to the questions on legislative processes. 

What these responses do show is the generally low level of knowledge which 
respondents have in general. For example, items 25 through 29 constitute 
a projective device, designed to elicit the respondents' ability to re- 
cognize the complexity of legislative process in contrast to the simple, 
idealistic view that congressmen should vote on principle alone. Two 
congressmen were presented: one, Jones, was described as voting according 
to his convictions and the constituents' interests alone. The other, 

Smith, was described as voting in a similar way some of the time, but open 
to vote-trading in some circumstances. Thus Jones represents the idealistic 
(and unrealistic) view of a congressman. 

While the majority of respondents ( 69 %) thought that most congressmen 
actually behave like Smith, a majority (73$) also believed that congressmen 
ought to behave like Jones, the idealist. Thus the ideal prevails as a 
norm, even when respondents seem to recognize that the norm is not realistic 
The same patterning appears in responses to questions concerning the actual 
versus preferred behavior of Jones. For example, only l4 per cent of the 
respondents believed that Jones would vote on the basis of both his own 
personal convictions and the constituents' interests, yet 45 per cent pre- 
ferred that he utilize both interests in making his decisions. 

With respect to actual legislative procedure, few respondents could 
give a reasonable explanation as to a circumstance under which Smith would 
trade a vote (27 per cent). Also, only 15 per cent could supply one of 
several possible reasons as to the way a bill can be kept from being voted 
on (such as filibustering, tabling the bill, killing it in committee). 

On the other hand, most respondents believed that the order in which a bill 
is presented would be important for its passage (88 per cent), and further- 
more, that presenting a bill early in session would favor its passage (87 






per cent ) . 

In summary, except for those questions which deal specifically with 
the order of presenting a bill to the legislature, respondents are not 
highly knowledgeable about legislative procedure. While it is recognized 
that congressmen cannot always vote according to principle, the reasons for 
their deviation from the ideal are not understood. One suspects that 
the respondents might view such congressmen as being immoral or irrespon- 
sible. We should point out, however, that the generally low level of 
political sophistication, and the small amount of variation in knowledge 
or political orientation by social type is not unexpected. Literature 
on political socialization of adolescents documents the generally low level 
of political involvement by both adolescent and adults and suggests that 
activity in organization or discussion with a parent who is knowledgeable 
are more important for understanding adolescent political involvement 
than the combined strength of background factors such as sex, class and 



race. 



A final point in connection with the Legislature game concerns 
questionnaire item 34, a question which measures not actual knowledge 
about legislative processes but rather the degree to which the individual 
feels that he can have some effect on these processes -- i.e., it is 
really an indicant of sense of control specifically with respect to 
politics . Table 8, which shows the proportion of negative responses 
to this item, controlling to pairs of background variables, suggests 
that political sense of control may also be related to ascribed character- 
istics. In our sample, the strongest effect is the racial one, with whites 
displaying consistently greater sense of political control than Negroes. 
This is as one would predict, but unpredictably, there are also fewer 
negative responses among lower than middle-class respondents and among 
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females than males. 

The relatively strong trends in Table 8 suggest that it would be 
useful to explore this variable further, in particular comparing it with 
general sense of control as an independent variable related to game know- 
ledge and performance. While Table 7 showed that a general sense of 
control of destiny did not account for much of the variation in pre-test 
legislative knowledge, it might be profitable to examine whether a 
feeling of control specifically referring to political power is a better 
predictor of legislative knowledge and performance. Some analyses of 
this sort will be presented in Section 3. 

With respect to the questions aimed at information felt to be im- 



portant elements of the Life Career game, the responses axe more complex. 
First of all, there are several items which apparently were already common 
knowledge. For example, 89 per cent of the students agreed that the de- 
cisions made now may have a big effect on life in later years. This con- 
sensus is somewhat surprising because the lower class has been by many 
commentators described as ’’lacking future orientation. Possibly the 



belief is deducted from the observation that lower-class individuals 
often behave as though the future is not dependent upon the present. 

In addition, one interesting piece of common knowledge for our respondents 
(98 per cent) is their recognition that education is inversely related 
to the likelihood of divorce. Finally, few students were aware that a 
private liberal arts school is the most expensive post -high school 
(33 per cent) or the school with strictest entrance requirements (20 
per cent) . 

Another set of questions about career planning resembles the type 
of s imulat ion presented in the Career game itself. A profile of a boy, 
Tom, was introduced and a number of questions were asked with respect 
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to Tom’s likely future behavior. Tom was described to be a capable, 
poorly-performing student. His economic status is suggested to be good 
and relations with his parents are implied to be favorable. Tom’s 
major difficulty is with his teachers. His major interests are "automobiles 
and good clothes." In other words, Tom has the potential to be success- 



ful educationally, but he is preoccupied by other activities from handling 



his problem. 

For most statements concerni*^ Tom’s behavior, there were no 
variations by social type of respondent. A majority believed that Tom 
should stay in school (6l per cent). Most students were aware that 
upon marrying, his wife would be his own age or a little younger (69 per 
cent). They less perceived that his wife would likely have the same 
amoun t of education as Tom (33 per cent) and be working (57 per cent). 

Most students would advise Tom to wait until 20 or older to marry (92 
per cent). Furthermore, Tom would be advised to have three children or 
less (73 per cept). Most agreed that Tom’s least satisfaction in life 
would be in his education (71 per cent). It is interesting that there 
is no variation by race, sex, or class in response to preferred family 
size, a finding which supports the hypothesis that the larger family size 
ty rr ) rm g lower class and Negro groups reflects unavailability or knowledge of 
contraception, not a preference among such subpopulatioiis for larger 
families (HEW Indicators* 1966). 

One type of question in the career section does elicit differences 
in response by race, class, and sex, as shown in Tables 9-12. These 
items are similar in that they all concern the interrelationship of the 
various spheres of life activity -- work, family, and leisure. In other 
words, these items tap the respondents* cognitions of the structuring of 
society -*• his recognition of its complexity, the interdependence of 



one type of decision upon another, and the implications of this inter* 
dependency for his own career planning, (indeed a major intention of the 
Life Career game is to assist students in understanding the complex de- 
cision-making system within which he must operate,* and the game is de- 
signed so that there is a rough correlation between educational and 
occupation success and satisfaction in the realm of family and leisure 
activity.) 

Table 9, 10 and 11 indicate a generally greater understanding of 
these interrelationships among Negro respondents. They are more likely 
to recognize that having children reduces resources of time and money 
in other areas, and this relationships holds when either class or sex 
is controlled (Table 9); they are more likely to recognize the relation of 
educational-occupational status and marriage opportunities when sex and 
race are controlled j and at both social class levels they are more likely 
to realize the effect of one's personal resources (of money and education) 

upon enjoyment of leisure time (Table 11) • 

In other words, what the tables as a whole seem to reflect is the 
Negro yo ung ster's earlier or more direct experience of the realities of 
life. U nlik e the more protected white student, he is more likely to have 
seen the consequences of having too many children and too little money or 
education. 

Some other relationships in the tables also reflect the extent to 
which understanding of the situations simulated in the game is initially 
affected by previous real-life experience or roles. For example, in T&bie 
9, in addition to the racial relationship, being lower class and being 
female also makes one more likely to recognize the effects of children upon 



* Or that he must change if he does not like the present normative 
structure. In one of our more notable game sessions, one team of 
boys developed a winning strategy by having their person pass through 
a series of marriages 1 
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TABLE 9 . Percentage of Respondents Who Agree That Having Children Means 
That A Person Has Less Time and Money To Spend On Other Things 
By Race and Class, and By Race and Sex 





Negro 


White 


€ 


Lower Class 


68 


53 


15 


Middle Class 


0 

ITY 


4l 


9 


f 


18 


12 





f 

S-. 





Negro 


White 


t 


Male 


50 


43 


7 


Female 


62 


45 


17 


i 


-12 


-2 








TABLE 10. Percentage of Respondents Who Agree That The Kind of Person You 
Will Marry Depends Qn How Mach Education And Which Occupation 
You Have By Race And Class, And By Race And Sex 





Negro 


White 


* 


Lower Class 


50 


34 


16 


Middle Class 


42 


31 


11 


i 


8 


3 







Negro 


White 


l 


Male 


50 


4l 


9 


Female 


42 


25 


17 


£ 


8 


16 
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TABLE 11. Percentage of Respondents Who Disagree That You Don’t Need Money 
Or Education In Order To Enjoy Free Time 





Negro 


White 


t 


Lower Class 


73 


62 


11 


Middle Class 


90 


72 


18 




-17 


-10 





Negro White £ 

Male 75 71 4 

Female 77 ® 

( -10 -6 
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t ime and money resources. These findings are consistent with the greater 
likelihood of a large family and insufficient income in lower-class groups 
q nd with the greater involvement of the female role with children generally • 
Likewise, the lower-class group, having had more experience with too little 
money, are more likely to recognize its importance for enabling one to 
enjoy life (Table 11). 

Finally, Table 12, shows responses to the semi -projective question 
asking respondents to indicate which of the four general life areas they 
would expect to be most satisfying for a fictitious boy who is described 
as having a rather hedonistic orientation toward life. It is the higher 
status (white or middle class) respondents — i.e., those who have been 
more likely to observe in real life a varied, rewarding (and expensive) 
range of leisure time activities -- who are more likely to pick this as 
"Tom' s" major source of satisfaction. 
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TABLE 12. Percentage of Respondents Who Say Tom Will Find His Greatest 
Satisfaction In His Leisure Activities by Race and Class, and 
by Race and Sex 





Negro 


White 


k 


Lower Class 


36 


32 


4 


Middle Class 


62 


60 


2 


e 


-26 


-28 







Negro 


White 


€ 


Male 


35 


46 


-11 


Female 


39 


71 


-32 


6 


-4 


-25 
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SUMMARY 



Figure B shows the kinds of relationships we have analyzed in this 
section. Our data indicated that the student's background has meaningful 
effects both upon his feelings of control over his environment and his 
actual performance upon tests of his knowledge of career decision-making 



political process, although the effects involve interactive relationships 
among a cluster of ascribed characteristics rather than simple, direct 
uni -variable relationships. An individual's knowledge and skills were 
also shown «o depend upon his control beliefs as well as his social back” 
ground. These relationships were also complex ones, with the specific 
pattern of relationships dependent partly upon the subject matter to 
be learned and the school context. Finally, sense of control itself was 
seen to be a complex set of attitudes, ranging from a general* sense of 
being in command of one's future to feelings of potency or adequacy with 
respect to particular areas of life (eg., politics). 
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2. Effects of Exposure to Gaines 

The focus of this section is the treatment variable of exposure 
to simulation games, and the following analysis will consist of a series 
of comparisons between respondents who were members of experimental 
groups with those who were taught the same subject matter by more con- 
ventional methods. The discussion will begin with a comparison of the 
amount of learning in experiment al and control groups, then move to an 
examination of the relationships of learning and control beliefs, and 
finally incorporate the additional background variables which have al- 
ready been found to be related to control beliefs. 

Bl. Amount of Learning . The most basic question is simply whether 
the experimental respondents learned as much or more than their controls. 
Table 13 shows these comparisons at both the aggregate and individual 
levels. The two left hand columns of Table 13 compare the mean scores 
on the Career Knowledge and Legislature Knowledge scales for experimental 
and control groups, before and after the experimental treatment. On both 
scales the control group gains are stronger than the mean score increases 
in the experimental group. 

While mean scores are a useful summary device, they may obscure 
important patterns in the data, so we also examined changes in scores 
among individual respondents. The two right hand columns of Table 13 
show what proportion of the individual respondents learned — that is, 
displayed a higher posttest knowledge score. The pattern for the in- 
dividual respondents is, however, the same as for the mean scores. Ap- 
proximately hal f of both the experimentals and controls displayed higher 
posttest career knowledge scores. On the other hand, a fbll forty per 
cent of the experimentals unlearned with respect to legislative knowledge 
(in contrast to twenty-one per cent of the controls). Thirty-nine per 
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TABLE 13. Comparisons of Experimental and Control Groups on Career 

and Legislative Knowledge 



% of Individual Respondents 



Mean Knowledge Scores 


Whose Posttest 


Score Was: 


Pre-Test Posttest 


Higher than 
Pre-Test 


Lower than 
Pre-Test 



Career Knowledge 


Experimental 


8.9s 


9.08 


51 


28 


Control 


8.76 


9.35 


50 


25 


Legislative Knowledge 


Experimental 


3.69 


3.72 


28 


ho 


Control 


3.74 


4.05 


39 


21 
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cent of the controls displayed an increase in knowledge posttest in 
comparison to only twenty-eight per cent of the experimentals. 

From this latter data on individual patterns of learning, it ap- 
pears that with respect to career knowledge the game and conventional 
techniques are equivalent in success* In contrast, the game appears to 
have had deleterious effects upon many subjects with respect to legis- 
lative knowledge in contrast to the conventional techniques which at 

least showed a modest success rate. Later in the section we shall examine 
' • ♦ 
external sources of posttest knowledge in order to elucidate the process 

of g nTnp learning versus classroom learning. 

B2. Learning and Control Beliefs . Given that there was some learn- 
ing in both the experimental and control groups, what are its sources, 
and do they differ for those who learned in the game compared to those 

who learned in the control situation? 

Among the most important findings of the Coleman report was the high 
predictive power of feelings of control for actual performance on achieve^ 
ment tests. In our analysis, we attempted to examine the effect of control 
beliefs upon actual learning — i.e., to see to what extent the belief in 
control of destiny a participant felt at the beginning of the experiment 
was related to the knowledge he or she had at the end and to see whether 
this effect differed in the experimental and control situation. Our re- 
sults (data not shown) indicate no support for the predicted relationship 
between initial sense of control and subsequent learning. Even when we 

examined the individual items comprising the knowledge scales, there were 

♦ 

few instances where those with a sense of control on the pre-test have a 
higher degree of knowledge on the posttest. In fact, the reverse is true 
on several items among the control respondents. (And since pre-test 
sense of control and nr e -test knowledge are also not strongly related, 
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this lack of support for our hypothesis cannot he explained by a higher 
initial knowledge among those low in control beliefs.) 

While this analysis has used control belief as the independent 
variable and learning or knowledge as the dependent variable, it is 
also possible to reverse the designation of variables __ to examine the 
effects of different modes of learning upon subsequent sense of control. 

It had been expected that the experimental subjects would display a greater 
sense of control over environment following game experiences in which 
their decisions were shown to have direct effects upon game outcomes. 
However, since this prediction was based upon extended or long-term ex- 
perience in simulated environments, our actual field test, of shorter 
duration them we had originally planned and allowing for only a single 

play of a game, was not really an accurate test of this prediction. On 

» ’ 

the contrary, it is more reasonable to predict that a superficial, brief 
exposure tp the game, in which the spinners and other chance devices 
often seem to be the dotiaant feature, would actually heighten one’s be- 
lief in the caprice of social situations and environments. 

Table 14, showing the relationships between experimental vs. control 
treatment and the three measures of sense of control, indicates no clear 
evidence that game experience either increases or decreases players' sense 
of control differently from the more conventional classroom situation. On 
the Coleman scale, the experimental subjects had a greater proportion who 
increased sense of control (thirty-one per cent) than the controls (twpnty- 
two per cent), and fewer experiment als experienced a decrease in sense 
of control (thirty-one per cent, compared to thirty-eight per cent of 
the controls), but these differences are hardly impressive. Furthermore? 
the patterns are not replicated in the I scores. 

If control is not the direct outcome of game exposure, it is still 



possible that the learning experience itself, whether through the game or 
conventional methods, leads to an increased sense of control. The relation- 
ship between changes in scores on the Legislature and Career Knowledge 
Scales and the Coleman Control Scale are examined in Table 15. Among those 
in the control groups who learned, it was most likely that an increase in 
sense of control also occurred (forty- four per cent for both legislative 
and career knowledge) . However, those who unlearned in the control groups 
were eq ually likely to have a greater sense of control post-instruction 
(forty -three per cent and forty- seven per cent). In the experimental 
groups the relationships are different. Of those who learned legislative 
knowledge, a loss of control was more likely than a gain (fifty per cent 
and nineteen per cent), while those who lost knowledge were most likely not 
to change position with respect to control beliefs (fifty-eight per cent 
for legislative and fifty per cent for career knowledge). Clearly, sense 
of control does not emerge directly from learning. While it is likely to 
follow learning, at least by conventional methods, it is just as likely to 
follow a negative change in test scores. A similar pattern was found when 
change in I score is used as the measure of control (data not presented). 

B3. Adding the Effects of Background Variables . Since we have al- 
ready found that control is intricately related to background variables 
which may themselves influence learning, the preceeding analysis in which 
rmi y one variable was controlled at a time, was not very satisfactory. 

In order to consider all the possible sources of learning included in the 
model and research design, several regression analyses were made. Post- 
test knowledge on the career and legislative items respectively was ex- 
amined as dependent upon pre-test sense of control (I scores and Coleman 
scale), pre-test knowledge, grade average, sex, race, class, and the 
subject* s school (which consisted of three dummy variables to treat the 
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TABLE 15. Changes in Pre-Test-Posttest Knowledge Scores by Changes in Pre-Testf 
Posttest Control Scores, in Experimental and Control Groups 



Experimental Group 



Control Group 



Legislature Knowledge Pasttest Score Is; 
Control Posttest Score Is: 


higher 


same 


lower 


higher 


same 


lowei 


higher 


19 


42 


29 


44 


30 


43 


same 


31 


21 


58 


33 


44 


43 


lower 


50 


37 


13 


22 


26 


14 




(16) 


(19) 


(24) 


(27) 


(27) 


(14) 




Experimental Group 


Control Group 


Career Knowledge Posttest Score Is: 
Control Posttest Score Is: 


higher 


same 


lower 


higher 


same 


lower 


higher 


30 


38 


25 


44 


18 


47 


same 


40 


24 


50 


35 


47 


41 


lower 


30 


38 


25 


21 


35 


11 




(30) 


(13) 


(16) 


(34) 


(17) 


(17) 
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effects of each school in contrast to the other two). The regressions 
were run separately for experimental s and controls as a means for identify - 
ing differences in game learning versus conventional learning. . 

Tables l6 an d 17 present the proportion of variance in posttest know- 
ledge explained by each of the variables. With respect to the effects of 
pre-test control upon learning, the results indicate that a sense of con- 
trol over the environment — whether measured by I score or the Coleman 
scale — explains a 1 proportion of the variance in posttest knowledge. 
Two other variables make much greater contributions. As we would expect, 
pre-test knowledge is one major variable. It should be very surprising 
if a score on the posttest did not include that portion of information 
known on the pre-test. The other major predictor, perhaps surprisingly, 
is the school. More specifically, attending the all-white school, C, 
explains a considerable proportion of variance in posttest knowledge. 
Background variables are of least importance, and of these, only race 
appears consistently to affect learning. 

In comparing the importance of the variables in the experimental 
to the control subjects, several dissimilarities are notable. These dif- 
ferences occur for both career and legislature knowledge. First, pre- 
test knowledge explains much more variation for learning by conventional 
methods than by the game method. Secondly, the school or learning en- 
vironment is more important for explaining posttest knowledge in the game 
as against the classroom situation. This is particularly true for learn- 

Vs, 

ing legislative knowledge. Finally, although race explains only a minor 
part of the variance in learning by either method, it is more important 
for the game. 

b 4. fflmryrp in gproantic Differential Items . Before summarizing the 
results of Section 2 we shall just mention another type of game effect 
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TABLE 16. Proportion pf Variance in Posttest Career Knowledge, By Experimental 
Treatment, Sense pf Control, Background Variables, And School 



Post Career 





Ex 


Con 


Control: 


3.05 


1.05 


Positive I 


.90 


.61 


Negative I 


1.22 


.13 


Coleman 


.93 


.31 


Pre-Test Knowledge: 


13.29 


25.1*3 


Background: 


2.84 


1.08 


Sex 


• 

vn 

00 


.60 


Class 






Race 


2,26 


.1*8 


Grade Average 






School: 


25.50 


18.96 


A 


* 


3.33 


B 






C 


25.50 


15.63 


Over-All: 


44.68 


46.52 
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TABUS 17 . 



Proportion of Variance in Posttest Legislative Knowledge, By 
Experimental Treatment, Sense of Control, Background Variables, 
And School 






Control: 
Positive I 
Negative I 
Coleman 



Post Legislative 



Ex 



2.77 



2.13 

.64 



Con 



4.89 



.44 

4.42 

.03 



Pre-Test Knowledge: 



17.52 



22.09 



Background: 

Sex 

Class 

Race 

Grade Average 

School: 

A 

B 

C 



2.79 

% 

2.79 

39.21 

.51 

38.70 



3.18 

1.69 

.40 

.34 

.75 

10.89 

1.52 

9.37 




which we considered but which will be treated in greater detail in 
Section 3* This was the change in conceptual organization of subjects 
toward a numb er of objects referred to in the games: self, politics, 
my future, learning, luck, congressman, fun, and planning ahead. There 
were no specific hypotheses concerning the change we expected. Rather, 
we wanted to use the material to assist in understanding game experiences. 
The items selected for the scales were selected to measure the responds * 
attitudes along three dimensions: his evaluation of the object (good, 
pleasant), his perception of the activity of the object (active, lively), 
and his attribution of power to the object (strong, tough). Three ad- 
ditional scales were idiosyncratic in nature: interesting, honest, daring. 

Two forms of analysis were made. One compared the mean scores for 
each item per concept to see the direction of movement, if uny, before ahd 
after experimental, treatment. Thus one could see whether, for example, 
"planning ahead” was viewed as more interesting post-game, or, whether 
congressmen were perceived to be less honest. Some differences did occur 
in the experimental groups in contrast with the control. However, since 
further analysis with school held constant showed that these changes 
occurred differently at each of the three schools, we shall defer further 
discussion of the game effects until the subsequent section of the report. 

Another technique permitted us to look at the distances between 
concepts before and after experimental treatment. Following Osgood* s 
formula (1957), conceptual distances were computed on the basis of the 
responses to the evaluation, activity, and potency items. The purpose 
of this analy sis was to examine whether the conceptual organization of 
the concepts reorganized as a result of the game or conventional learning 
experience. The procedure would permit us to see whether, for example, 
politics self became more closely related in conceptual definition. 
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The results in general showed that all distances between the concepts 

■ ■ . 
decreased following the experiment. There were no school or experimental 

treatment variations. Given this consistent lack of variation, and 

* 

similar movement across all items, it seems plausible that the shrinkage 

in conceptual distance is related to unreliability of the measure or 

to a test effect, rather than to any actual change in respondents* cognitive 

sets. 
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SUMMARY 

In the preceeding section, we have expanded our exploration by in- 
troducing the treatment variable of simulation games vs, readings and 
other conventional classroom activities and have examined the effects of 
the two treatments upon both learning and changes in sense of control. 
Figure C shows the directions in which our model has evolved. 

Our findings did not show any advantages of the games over regular 
classroom activities, at least for the exposure allowed in this experiment. 
Rather regression analyses indicated that learning is explained by a more 
complex set of variables, including initial knowledge and background 
factors as well as teaching technique. This analysis also indicated that 
aggregating the data from all the schools conceals some important in- 
formation about the dynamics of learning. This leads us to Section 3 in 
which many of these relationships will be re-examined in the light of the 
school context in which they occur. 
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3. Effects of School Context 

Although we have not yet directly examined the effects of the 
various schools in which the experiments were conducted, we have al- 



ready obtained clues that this variable may explain part of the vari- 
ance in learning and attitudes. (E.g., we have seen that school con- 
text was a major predictor of pre-test knowledge in connection with 
the Legislature game.) In this section we sha l l consider the simul- 
taneous effects of school and treatment variables upon: extent of 
learning; changes in conceptual orientation; and changes in control 
beliefs • 

Cl. Degree of Learning . In Section 2, we saw that while there 
was over-all learning in the classes using conventional learning 
methods, increases in learning seemed to occur only in connection 
with career knowledge in the simulation groups. Table 17 shows this 
same a naly sis with school held constant for the three different 
schools • 

The left two columns of Table 17 present the mean knowledge scores. 



pre-test and posttest, by school and experimental treatment. For career 
knowledge, the scores are notably higher on the posttest for three 
groups: School B control, and School C, experimental and control. If 
one looks at the proportion of subjects whose posttest career knowledge 
increased, in the right hand columns, one sees that the experimental 
group at School B also had a high ratio of individuals who improved 



their career learning scores relative to the per cent whose scores 
dropped. (Apparently the net decrease in mean scores was caused by a 
severe drop in score among a small number of individuals.) At School A 
there was as much unlearning as learning, by either teaching method* 



With respect to legislature knowledge, a more negative set of re- 




suits appear. The mean scores presented in Table 1? show an increase 
again for the controls in School B and C, and the experimentals in 
School C. On the other hand, for the other three subsamples, post- 
test knowledge scores decrease . The individual learning patterns re- 
veal the underlying trend. Of those who change in School A and the 
experimental group in School B, most unlearn pre-test knowledge. 

In addition to examining mean scores and individual change patterns 
the items composing the over-all scores were examined individually. The 
purpose of this analysis was to discover if there were any outstanding 
deviate items in the scale. In other words, could the mean changes and 
individual pattern changes obscure the actual pattern of learning and 
unlearning? In fact, there is a remarkable consistency between the 
patterns of change in the learning of individual items as reflected in 
the over-sill measures (data not shown). The controls at Schools B and 
C, and the experimentals at School C are likely to show increase in 
knowledge on each item. The experimental group at School B is likely 
to show an increase of career knowledge, but not of legislature know- 
ledge. Both treatment groups at School A show little learning, and 
more likely, unlearning of individual items. 

What explains these differences across schools? There are several 
plausible interpretations, and while none can be substantially tested 
with our present data, we can make some educated guesses based upon 
field experiences. 

One possibility is difference in teacher effectiveness. One could 
interpret the general lack of success at School A to ineffective teach- 
ing (or conversely, the generally positive effects at School C to the 
high quality of the teaching regardless of the particular teaching 
method used) . However, our impression from our work with the teachers 



before and during the experiment is that, if anything, the teachers 

at School C were more anxious about the whole project and more resistant 
' to the notion of simulations. We had, in fact, expected the most 

positive results at School A because of the teachers involved in the 

\ 

.project there. As further support for our contention that teacher 
effect was not a main source of variation, the posttest-only groups 
display a level of knowledge comparable to that found within their 
respective schools. (See Appendix C for data.) Thus both teachers 
at School A had the same lack of success, and both teachers at School 
C had the same success. 

The within-school similarity in results suggests the possibility 
that the student composition at the three schools is relevant. Even 
though all of the students are in the middle track, the students at 
School A have lower IQs and grade averages than those at the other two 
schools. These scores reflect a lower achievement in academic situations. 
The failure of the School A subjects to respond to either technique could 
then be simply part of a general pattern of poor academic achievement. 
Another problem which may have confounded the findings is the 
actual treatment situation. Prom our experience, there is a wide 
variation in the extent to which games at the early stages "go well.” 

It may be that the particular grouping of students at School C consisted 
of the — as yet unknown -- qualities which make a game viable from the 
start without protracted orientation periods. Unfortunately, we have no 
information as to the degree to which the game playing may have varied 
across the schools. 

Another possible explanation for the higher rates of learning at 
School C is pre-test effect. Pre-test exposure requests for information 
may interact with experimental treatment and thus falsely increase post- 
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TABLE 17o Comparison of Experimental and Control Groups on Career and 
Legislature Knowledge, By School 





Mean Knowledge Scores 


<f 0 of Individual Respondents Whose 
Posttest Score Is: 








higher than 


lower than 


change 




Pre-Test 


Posttest 


pre-test 


pre-test 


ratio* 


r SCHOOL A 

Career Knowledge 


Experimental 


8.89 


8.84 


33 


33 


.00 


Control 


8.59 


8.65 


4l 


4l 


.00 


Legislature Knowledge 


Experimental 


3-74 


3.53 


22 


50 


-.38 


Control 


3.82 


3.24 


18 


35 


1 

• 

u> 

ro 


SCHOOL B 


Career Knowledge 


• 










Experimental 


8.33 


8.14 


55 


14 


.59 


Control 

Legislature Knowledge 


8.29 


8.86 


52 


29 


.38 


Experimental 


3.24 


2.90 


32 


45 


-.17 


Control 


3.24 


3.62 


29 


19 


.21 


SCHOOL C 

Career Knowledge 


Experimental 


9.74 


10.42 


63 


16 


.59 


Control 


9.20 


3.0 • 10 


53 


13 


.61 


Legislature Knowledge 


1 Experimental 


4.21 


4.79 


26 


26 


.00 


Control 


4.03 


4.83 


60 


13 


.64 


I * Change 


Ratio = 


# higher minus # lower 
# changes 





o 

ERIC 
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test scores. All of our posttest measures were also on the pre-test. 

(Some unfamiliar items would have been a useful independent check.) 

There is also the memory effect of the pre-test and students at School 
C ? being the more facile learners to begin with, are most prone to a 
response based upon previous experience with the task. In fact* data 
in Appendix C indicate that some pre-test effects may have occurred 
at School C, but not at School A, the other school with posttest-only 

groups . 

If the results are related to teacher* student, or game variables, 
then the hypothesis under consideration are not invalidated. Rather, 
we are led to consider that there are particular conditions under which 
it operates and to design further research on these possible conditions. 

If, however, the results are primarily the result of measurement error, 
then a devastating conclusion results: there was no learning by either 
technique within any of the diverse settings. The possible validity of 
this la tter explanation is weakened when School B is considered. In 
this setting one game appears to have had some effect. Further on we 
shall see other reasons to believe that the school and treatment variations 
in learning reflected in our data are not spurious. 

C2. Conceptual Reorganization . Another type of game effect con- 
sidered by the study is that of basic conceptual reorganization. It 
was not unexpected that the games as played for a short period in this 
study wo ul d have similar, not necessarily better, success than conventional 
techniques in transmitting factual-type knowledge. It is our contention 
though that the games would also induce changes of a basic conceptual 
nature unlikely through traditional learning techniques. Active parti- 
cipation through games in contrast to the passive conventional class- 
room experience seems to be in light of past research a more likely set 
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ting for attitude reorganizations,* 

The semantic differential scales were used to measure one type of 
basic conceptual change --the subject’s definition of relevant objects 
in terms of their attractiveness, potency and activity. In our analysis 
of the respondents’ definitions before and after experimental treat- 
ment, one consistent trend appeared: experimental groups at Schools A 
and B exhibited a redefinition of several objects, while the controls 
did not. There were some minor differences between experimental and 
control at School C, though not of the degree. 

Tables 18 through 25 present the mean scales positions on the 
pre-test and posttest for each concept by school and treatment. Care- 
ful inspection of the tables suggest the following results. 

' 1) School A: There are clear differences between experimental 

and control groups in the redefinition of most of the concepts. With 
respect to the following concepts — planning ahead, future, learning, 
self, congressman, politics — the experimentals are likely to move in 
the direction of defining the objects as more attractive, strong, and 
active. The controls are not likely to change position at all, and in 
some instances, move in the reverse direction. 

2) School B: Here there are fewer instances where the experimentals 



* The g am es are not quite the ’’group decision” situation typical of 
research on attitude change, but they do include many characteristics 
of a group- decision setting: issues which involve a course of action; 
free discussion; feedback on attempts to obtain information; final 
decisions which force an individual to make some final commitment; 
the opportunity to test new actions. Conventional classroom settings 
resemble "lecture" conditions of such experiments. Students form a 
relatively passive audience; are not required to make decisions on 
issues; are unable to perceive others’ attitudes not of the same degree. 
Participation is much more self-initiated than in the game. For a 
review of research on groups as agents of attitude change, see Secord 

and Backman (1964). 
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TABLE 18. Semantic Differential 



Mean Scores for Planning Ahead, By School 





Experimental 

Pre-Test 


Posttest 


Control 

Pre-Test 


Posttest 


SCHOOL A 


good 


5.80 


6.40 


6.44 


6.33 


strong 


5.00 


6.05 


5.28 


6.00 


active 


5.25 


5.45 


5.94 


5.89 


tough 


4.45 


4.20 


4.22 


3.94 


pleasant 


5.20 


6.25 


6.00 


6.00 


lively 


5.25 


5.75 


5.50 


5.28 


SCHOOL B 


good 


6.6l 


6.09 


5.91 


6.56 


strong 


6.o4 


5.96 


5.52 


6.13 


active 


6.13 


5.74 


5.52 


6.o4 


tough 


4.52 


4.48 


5.09 


5.30 


pleasant 


5.87 


6.30 


5.78 


5.83 


lively 


5.61 


5.61 


5.78 


6.o4 


SCHOOL C 


good 


5.74 


6.26 


6.03 


6.28 


strong 


4.74 


5.63 


5.55 


5.55 


active 


5.11 


5.32 


5.38 


5.44 


tough 


it. 00 


4.63 


4.83 


5.20 


pleasant 


5.11 


4.73 


5.55 


5.31 


lively 


4.53 


5.42 


5.00 


5.14 
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TABLE 19 c Semantic Differential 

Mean Scores for Future, By School 





Experiment al 
Pre-Test 


Posttest 


Control 

Pre-Test 


Posttest 


SCHOOL A 


good 


6.20 


6.75 


6.28 


6*11 


strong 


6.10 


6.20 


5.67 


5.83 


active 


5.45 


6.30 


6.11 


6.39 


tough 


3.90 


3.40 


4.28 


3.83 


pleasant 


6.15 


6.55 


6.17 


5.89 


lively 


5.95 


6.05 


6.11 


5.94 


SCHOOL B 


good 


6.o4 


6,00 


6.09 


6.00 


strong 


5.83 


5.57 


5.74 


5.86 


active 


6.30 


5.87 


5.96 


6.34 


tough 


4.17 


4.09 


5.17 


4.83 


pleasant 


6.17 


6.00 


5.91 


5.83 


lively 


6.17 


5.61 


6.o4 


5.74 


SCHOOL C 


good 


5.84 


6.00 


5.69 


5.66 


strong 


5.37 


5.63 


5.83 


5.55 


active 


5.73 


5.21 


6.00 


5.76 


tough 


3.63 


3.89 


4.62 


4.83 


pleasant 


5.74 


5.68 


5.28 


5.55 


lively 


5.74 


5.53 


5.89 


5.72 



TABLE 20 « Semantic Differential 

Mean Scores for Learning, By School 





Experimental 

Pre-Test 


Posttest 


Control 

Pre-Test 


Post test 


SCHOOL A 


good 


5.65 


6.45 


6.11 


6.17 


strong 


4.50 


5.45 


5.28 


5.61 


active 


5.55 


6.05 


5.50 


5.39 


tough 


4.80 


4.05 


4.28 


_4.39 


pleasant 


5.55 


5.60 


5.72 


5.94 


lively 


5.40 


5.00 


4.89 


5.93 


SCHOOL B 


good 


5.17 


5.70 


5.91 


5.78 


strong 


5.22 


5.52 


5.34 


5.43 


active 


4.83 


5.30 


5.91 


5.78 


tough 


4.56 


4.13 


5.30 


5.61 


pleasant 


4.91 


5.39 


5.39 


5.91 


lively 


5.48 


5.35 


5.04 


4.87 


SCHOOL C 


good 


5.84 


6.21 


6.28 


6.21 


strong 


5-37 


5.53 


5.45 


5.62 


active 


5.79 


5.10 


5.21 


5.66 


tough 


3.63 


4.94 


5.41 


5.14 


pleasant 


5.74 


4.32 


4.52 


4.52 


lively 


5.74 


4.42 


4.4l 


4.69 
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TABLE 21. Semantic Differential 

Mean Scores for Me, By School 





Experimental 

Pre-Test 


Posttest 


Control 

Pre-Test 


Posttest 


SCHOOL A 


good 


5.75 


6.25 


5.28 


5.33 


strong 


5.10 


6.05 


4.89 


5.17 


active 


5.65 


6.05 


5.9 1 * 


5.72 


tough 


2.95 


3.55 


3-89 


3.83 


pleasant 


6.60 


6.45 


5-9^ 


5.94 


lively 


6.50 


6.30 


6.17 


6.00 


SCHOOL B 


good 


4.70 


4.65 


5.35 


5.39 


strong 


4.78 


5.13 


5.13 


5.13 


active 


5.17 


5.91 


5.87 


6.26 


tough 


4.17 


4.52 


4.52 


4.70 


pleasant 


5.21 


5.34 


5.91 


5.73 


lively 


6.o4 

♦ 


5.65 


6.o4 


6.17 


SCHOOL C 


good 


4.84 


5.21 


u.79 


4.97 


strong 


4.42 


4.47 


4.72 


5.00 


active 


5.00 


5.21 


5.17 


5.79 


tough 


3.58 


3.47 


3.38 


3.69 


pleasant 


5.16 


5.58 


3.52 


5.31 


lively 


5.16 


4.89 


5.38 


5.38 
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table', 22 . Semantic Differential 

Mean Scores for Fun, By School 





Experimental 

Pre-Test 


Posttest 


Control 

Pre-Test 


Posttest 


SCHOOL A 


good 


6.65 


6.80 


6.72 


6.33 


strong 


6 . 4 o 


6.30 


6.11 


5.33 


active 


6 . 4 o 


6.10 


6.67 


6.00 


tough 


2.75 


3.20 


4.83 


4.06 


pleasant 


6.70 


6.50 


6.33 


6.11 


lively 


6.50 


6.05 


6.28 


5.83 


SCHOOL B 


good 


6.78 


6.30 


6.74 


6.26 


strong 


6. U3 


6.09 


5.91 


5.22 


active 


6.87 


6.09 


6.48 


5.91 


tough 


4.30 


4.22 


4.65 


4.52 


pleasant 


6.70 


6.43 


6.57 


5.95 


lively 


6.43 


6.17 


6.61 


6.00 



SCHOOL C 
good 


6.79 


6.68 


6.24 


6.28 


strong 


6.16 


5.89 


5.79 


5.69 


active 


6.68 


6.63 


6.48 


6.52 


tough 


4.26 


4.00 


4.00 


3.90 


pleasant 


6.84 


6.68 


6.62 


6.45 


lively 


6.84 


6.53 


6.62 


6.34 
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TABLE 23 « Semantic Differential 



Mean Scores for Luck, By School 





Experimental 




% 

Control 






Pre-Test 


Posttest 


Pre-Test 


Posttes 


SCHOOL A 










good 


5.05 


5.85 


4.50 


5.33 


strong 


4,00 


5.30 


4.22 


4,6l 


active 


3.70 


4.70 


4.33 


5.56 


tough 


4.20 


3.65 


4.61 


3.44 


pleasant 


4.60 


5.50 


5.17 


5.50 


lively 


3.95 


4.4o 


4.89 


5.17 


SCHOOL B 










good 


4.35 


4.91 


4.43 


5.09 


3trong 


4.39 


4.83 


4.43 


4.30 


active 


4.70 


4.87 


4.35 


4.73 


tough 


4.39 


4.74 


3.91 


5.13 


pleasant 


4.43 


4.57 


4.65 


4.96 


lively 


4.61 


4.83 


4.65 


5.00 


SCHOOL C 










good 


5.58 


5.16 


4.79 


5.21 


strong 


4.53 


4.42 


4.65 


4.12 


active 


4.16 


4.10 


4.41 


4.66 


tough 


3.74 


4.21 


4.38 


4.72 


pleasant 


5-37 


5.00 


4.66 


4.62 


lively 


4.1t7 


4.79 


5.31 


4.90 
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TABLE 24. Semantic Differential 



Mean Scores for Congressman, By School 



SCHOOL A 


Experimental 

Pre-Test 


Posttest 


Control 

Pre-test 


Posttest 


good 


5.30 


5.80 


5.39 


5.39 


strong 


5.25 


5.75 


5.72 


4.89 


active 


5.00 


5.55 


6.44 


5.61 


tough 


5.35 


4.80 


5.44 


5.05 


pleasant 


5.30 


5.25 


5.83 


5.50 


lively 


4.45 


5.30 


5.39 


4.89 


SCHOOL B 


good 


5.43 


4.52 


5.61 


5.22 


strong 


5.43 


4.48 


5.13 


5.30 


active 


6.o4 


4.70 


5.30 


5.48 


tough 


5.13 


4.70 


5.22 


5.22 


pleasant 


5.00 


4.35 


5.04' *■ 


4.96 


lively 


5.39 


4.65 


5.18 


5,08 


SCHOOL C 


good 


4.53 


4.53 


4.24 


4.ia 


strong 


4.53 


4.74 


4.59 


5.38 


active 


5.26 


5.36 


4.72 


5.93 


tough 


4.58 


5.11 


4.75 


5.65 


pleasant 


4.53 


4.11 


3.90 


4.52 


lively 


4,89 


5.05 


4.4l 


5.59 
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TABLE 25 



Semantic Differential 



Mean Scores for Politics, By School 





Experimental 

Pre-Test 


Posttest 


Control 

Pre-Test 


Posttest 


SCHOOL A 










good 


4.45 


5.15 


5.22 


5.17 


strong 


5.00 


5.35 


4.78 


4.72 


active 


4.70 


4.4o 


5.50 


5.28 


tough 


4.95 


4.70 


4.89 


5.00 


pleasant 


4.35 


5.40 


4.6l 


4,56 


lively 


4.4o 


5.30 


5.34 


5.39 


SCHOOL B 










good 


4.39 


4.6o 


4.30 


4.83 


strong 


5.30 


5.22 


5.13 


5.00 


active 


4.48 


5.30 


5.56 


5.22 


tough 


5.43 


5.26 


5.13 


4.91 


pleasant 


4.35 


4.26 


3.91 


4.30 


lively 


5.39 


5.04 


5.08 


4.91 


SCHOOL C 










good 


3.68 


3.26 


3.86 


3.69 


strong 


4.74 


5.05 


4.89 


4.96 


active 


5.31 


5.47 


5.24 


5.62 


tough 


6.05 


5.74 


5.86 


5.86 


pleasant 


2.42 


3.10 


2,59 


3.14 


lively 


5.79 


5.58 


4.76 


5.34 
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and controls differ. For learning and self, the experimental redefine 
in a direction similar to School A experimentals, viewing these objects 
as more attractive, active, and strong. On two other items, though, 
School B experimentals redefine in the opposite direction. They are 
likely to see planning ahead and congressman as less attractive, active, 
strong. The differences in experimental effect on the redefinition of 
these two objects suggests that the games at each school took different 
paths or styles. For example, something may have occurred in the 
development of the Legislature game to give the School A players a 
positive reorientation toward congressmen, yet School B placer.'-. .1 
negative one. 

Two concepts redefined by School A game players were not at School 
B — future and politics. Again, we are led to presume that the course 
of the games at the schools may account for the lack of redefinition. 

3) School C: In most cases the School C respondents changed 

position little. When it occurred, movement was similar in both ex- 
perimental and control groups. 

The controls appeared to move differently on self than the ex- 
perimentals. School C experimentals have a more positive self-concept 
posttest, while controls have a more potent, active self-concept post- 
test. Also, unlike the changes at Schools A and B, it is the controls 
who redefine congressman as more attractive, strong, active -- not the 
experimentals • 

This brief survey of the changes in conceptual definition points 
out that the games did have some effect in contrast to the classroom 
situation, at least in School A, and probably in School B. What is 
interesting is that conceptual redefinition did not result at the school 
where games proved successful in producing factual learning. 
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Perhaps the School C subjects saw the games as educational devices 



and thus did not immerse themselves as fully as School A and B game 
players. Varying commitment to the game process would also explain the 
ease with which School C players were able to express that they had 
learned. School A and B jplayers may have still been too preoccupied by 
the novelty of the game experience to recognize its instructional 
qualities. This explanation is conjecture at this point and suggests 
the need for research on variations in individual commitment to the game 
in itself. 

The results on conceptual reorganization support our contention 
that games induce different ways of seeing one’s self and the concepts 
underlying the game situations. Traditional learning techniques are 
aimed at instructing a student to recognize the logic of how concepts 
relate to one another, e.g., the organization of a legislature. Games 
are a procedure not only for supplying the system of relationships, but 
for reshaping the player’s definition of the objects which are being 
related. Thus we would expect a student who takes programmed instruction 
on the legislature to learn about its structure and functions. Yet we 
would not expect him to hold quite different attitudes toward congress 
and politics as a result. Basic conceptual changes result from relating 
one’s self more directly to the topic at hand, as through a simulation. 

One problem though is that a brief experience with the games might 
produce changes of an indeterminate nature. If the first few rounds of 
a game "go well," then it is probable that conceptual redefinition would 
be different from that if the game had gone poorly. To give an il- 
lustration, the nature of the Democracy game is such that in early periods 
the players are likely to find deception a useful technique. However, 
a particular group of players may cohere well and set the more normal 
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type of bargaining off rather quickly. It seems plausible that players 
in the first instance would devaluate politics, while players in the 
second instance would not. 

This is not to imply that conceptual redefinitions would be un- 
predictable. Two conditions were missing from our experiment which 
would ensure that players’ redefinitions could better be predicted. 

First, if the games are played over a sufficient time period, then the 
effects of any one round's idiosyncracies in content should be lessened. 
Thus we would expect that any players who play the Democracy game long 
enough will move toward some basic definition of congressman and politics. 

Secondly, post -game discussion can assist in correcting the biased 
perspective any one player has developed. Thus a player ^o had had a 
streak of bad luck in the Career game would find in later discussion that 
most other players had been able to control many of their actions. His 
attitude toward planning ahead would no doubt change more positively from 
post-game to post-discussion. 

C2. Sense of Control and Learning . In a preceding section we saw 
that one hypothesis with respect to control beliefs was not supported by 
the analysis over all subjects. It was not true, as predicted, that there 
was a posttest increase in control for the game players. In fact, as 
many subjects lost as gained control following the game. Is this pattern 
repeated when we look at the respondents by school? 

Table 26 shows that there is little difference by school in pattern 
of change in control beliefs. The game players are as likely to gain as 
lose in amount of control, when measured by the Coleman scale. The class- 
room subjects in this case are more likely, if they change at all, to 
increase in degree of control. 

With regards to the Positive I scores, there is little difference 
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TABLE 26. Percentage Change in Sense of Control By School And Treatment Group 



SCHOOL A SCHOOL B SCHOOL C 



Ex 

(18) 



Coleman Scale 



Increased 


39 


Decreased 


33 


Positive I 

a 

Increased 


21 


a 

Decreased 


11 


Negative I 

a 

Increased 


16 


a 

Decreased 


42 



Con Ex Con Ex Con 



(17) 


(22) 


(21) 


(19) 


(30) 


35 


23 


43 


32 


37 


18 


27 


19 


32 


27 



29 


27 


29 


16 


10 


6 


5 


10 


21 


17 



35 


27 


10 


5 


20 


6 


18 


10 


5 


17 



a Movement at least 2 points in score 
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in the direction of change. Both treatment groups within each school 
change in a similar manner — towards an increase in control at Schools 
A and B5 towards a decrease at School C. 

The distributions of change are less clear with respect to Negative 
I control. Many of the game players at School A exhibited a loss of 
control of this type, while the classroom subjects increased. Change at 
the other schools is as likely to be in one direction as in the other. 

Given the lack of consistency across results by the various indicators 
of control, it is difficult to draw sure conclusions. Conservatively 
speaking, we can say that the hypothesis concerning game effects upon 

control beliefs was not supported. 

Perhaps the findings would be clearer if we knew what had occurred 
during the games. There could have been something about individual re- 
sponses to the uncertainty of the game situation such that sense of 
control was affected. Could those who gained in sense of control have 
been those who caught on quickly? Or, were those who lost in sense of 
control those who found the brief exposure confusing? We have no data 
to test these possibilities. 

All three indicators — the Coleman scale and I scores — are 
global measures of control. The Coleman items refer to a general 
fatalism; the I scores to control over intellectual achievement. It 
could be argued that change in these general predispositions would re- 
quire a more profound experience than our brief experimental treatments. 
What, then, of the possibility that sense of control over the content 
areas treated by the games increased? 

Two items on the questionnaire tapped sense of control with 
respect to each game problem. One item focuses on a basic goal of 
the Career game; awareness of the effects of one's decisions on future 
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life course. "It is almost impossible to plan your life in advance, 
because so much depends on luck or chance." When we look at the change 
in response to this item by school and treatment group (Table 27), it 
appears that an increase in sense of control is most likely among those 
three groups for which there was also learning of career knowledge: 
School B control, School C experimental and control. 

A comparable patterning results when we examine the change in sense 
of control with respect to the government. Table 27 again shows the 
individual change patterns by school and group for responses to the 
item. "People like me have no say about what the government does." 

In this case, individuals from the three groups in which there was un- 
learning of legislature knowledge are likely to display less control, 
if they change at all. Again, in the "hree groups in which learning 
occurred, individual changers are likely to increase in sense of 
political control. 

Does this mean then that individuals who learned are also likely 
to have an increased sense of control? It turns out that this is not 
the case. As with our findings in Section 2 - B2, those who have 
learned are not more likely to have experienced an increase in sense 
of control than those who unlearned (data not presented). Nor is it 
true that of those who increased in sense of control that there was 
any greater likelihood to have learned than for those who did not 
experience a change in control beliefs. 

In other words, there is something about the climate of groups 
which stimulate learning — whether in the game or the classroom — 
such that there is a heightened sense of control specific to content 
area. This is some type of group phenomenon, because it is not 
necessarily those individuals who learn who gain in sense of 
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TABLE 2' . Percentage Change in Content -Relevant Control By School and Treatment 





SCHOOL A 


SCHOOL B 


SCHOOL C 




Ex 


Con 


Ex 


Con 


Ex 


Con 


Career Control (item l) 


(20) 


(18) 


(22) 


(23) 


(19) 


(30) 


Increased 


15 


11 


l4 


22 


21 


17 


Decreased 


10 


17 


9 


- 


5 


3 


£1 

C.R. 


+.20 


1 

• 

no 

H 


+.20 


+1.00 


+.76 


+ .70 



Legislature Control (item 34) 
Increased 


5 


6 


5 


17 


21 


23 


Decreased 


10 


l6 


13 


5 


5 


4 


a 

C.R. 


-.33 


-.45 


-.44 +.55 


+.76 +.70 



N (increased control) - N (decreased) 
a The change ratio = N (changed) 
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control. Our data provide no eludes on whatever it is about the group 
process that induces both learning and increased sense of control. 

C4. A Note on Racial Context . It was stated in the introduction 
that one purpose of the study was to consider the results in view of the 
racial segregation of schools. This is one reason why the sample of 
schools was selected to include an integrated school, B. It happens 
though that while School B is about half Negro, our two groups are 
only twenty per cent Negro. Given the small numbers of Negroes in 
these samples, it was not possible to make the types of comparisons we 
had hoped for, notably, a comparison of Negroes at the integrated school 
with those at the all "Negro school. 

We did address one question: did the Negroes at the integrated 
school perform s imi larly to the over-all pattern of performance at the 
school? Table 28 presents the mean scores on knowledge and control 
scales, pre-test and posttest, for the Negroes at School B. Not only 
are the patterns of change in this subsample similar to those of the 
larger sample, but the mean values are very close to those of the re- 
spective group means. 

The s imi lar performance level of the Negro students to their 
fellow classmates recalls McPartland's (1967) findings concerning 
the effects of classroom desegregation on the academic achievement of 
Negroes. He found that school desegregation alone would not be beneficial 
to achievement growth of the Negro students. Rather, it is important 
that the Negro attend predominately white classes in order for there to 
be a beneficial effect. 

It would be interesting to investigate the extent to which' games 
could contribute to the further communication between Negro and white 
students at desegregated schools. In the conventional classroom it is 



TABLE 28. Mean Scores On Knowledge and Control Scales For School B Negroes 



Mean Score For 
Career Knowledge 
Legislative Knowledge 
Coleman Control 
Positive I 
Negative I 



Experimental (N=4) 



Pre-Test 


Posttest 


8.0 


8.0 


3.0 


2.8 


3.8 


3.8 


8.5 


9.3 


8.3 


7.5 



Control 


(N=5) 


Pre-Test 


Posttest 


7.2 


8.6 


3.6 


3.8 


3.2 


3.6 


6.6 


6.8 


8.0 


8.4 





possible to maintain unintentional spatial segregation and avoid cross- 
racial work groups (whenever the class does break up into sections). For 
many classes there are few opportunities where the class behaves as one 
interactive unit. Games, however, have a democratizing effect in that 
each individual must take some role and interact with many other role 
partners. Furthermore, the structures of the games are such that it is 
not possible to say that one particular role is "better" or of higher 
status than another. Thus games may be much more than an alternative 
teaching technique; they might be devices for establishing a cohesive 



classroom unit. 



SUMMARY 



Figure D presents the summary model of the various relationships 
explored in the study. This section focused upon school context as it 
contributed to variations in the treatment effects. 

We found that the two educational techniques were roughly equivalent 
in producing learning (or loss of it). The games worked well with those 
who learn well by conventional methods, the advantaged students at School 
C. 

Our findings suggest that games have other types of effects not 
produced by standard classroom techniques. Players' experiences apparently 
induce redefinitions of concepts basic to the simulations. 

Sense of control of a global sort is not related to game experience on 
the basis of our results, though there does seem to be some development 
of a sense of control over specific spheres of activity among members of 
groups which stimulate learning, whether game groups or classroom groups. 

Finally, we learned that the Negroes at the integrated school did 
not perform any differently from those in their respective groups. 
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FIGURE D. S ummar y Model: Analysis of Effects of Exposure to Simulation Games Vs. Conventional 
Classroom, Taking Into Account Racial Context 
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CONCLUSIONS 



Given that our results as a whole indicated far less, and less 
direct, impact of simulation games than we had hoped, we shall use this 
concluding section in which to specify the points at which our research 
design or techniques were weakest and to indicate ways in which we are 
attempting to overcome these weaknesses. 

First, the length of exposure to these two games was clearly in- 
adequate. While most research on games to date has concentrated upon 
one game over a relatively short period of time, it now seems clear that 
any real effects upon learning and upon such a deep-seated feeling as 
one's sense of control would require such longer exposure to the simulation 
technique, preferably with a number of different games, (in the parti- 
cular time limits within which we worked, it might have been preferable 
to introduce only one game and to allow more than one play and/ or follow- 
up discussion and reading.) 

It could also be that games may be much more effective for many 
students when supplementary or reinforcing activities are added. This 
possibility has been suggested by observation of otherwise "unsuccess- 
ful" students playing games. One sees them making very shrewd moves — 
and making them repeatedly enough to indicate that they are not simply 
random or lucky moves -— but they are seldom able to explain in words 
what they did. This phenomenon has been discussed by Bruner, who found 
that students are often able to perform intellectual tasks requiring 
the use of quite abstract rules or theories well before they can say what 
these rules or theories are. For example: 

It can be demonstrated that fifth-grade children can play 
mathematical games with rules modeled on highly advanced 
mathematics; indeed they can arrive at these rules induc- 
tively and learn how to work with them. They will flounder, 



78 



however, if one attempts to force upon them a formal, 
mathematical description of what they have been doing, 
tho u gh they are perfectly capable of guiding their be- 
havior by these rules (Bruner, i960, p. 38)* 

Of course, the highest order of understanding means not only being able to 
act effectly but also being able to say what you are doing. What we wish 
to mak e clear here, though, is that these are two distinguishable kinds 
of performance. The analysis in Section 3 of this report has suggested 
that while the games did not seem to be more effective than regular class- 
room activities in increasing factual learning, they did seem to have some 
distinctive effects upon players’ cognition of certain underlying concepts. 
The research implication is that it will not be possible to test our belief 
in the importance of gaming for certain types of students without designing 
some ways to measure different kinds of learning. 

It may also be that games per se are intrinsically limited in their 
effect -- that, in Bruner's terms, they may induce ’’enactive" and "iconic" 
learning but do not lead the player to symbolic representation. If so, 
they should be linked to other devices which may produce the kinds of de- 
sired learning which they do not do directly alone . 

The preceeding paragraphs have raised two different issues -- (l) 
the problem of clarifying what sorts of learning games do produce most 
effectively and (2) the possible need of reinforcing the game activities 
with other kinds of activities which will fill in the kinds of learning 
that games do not handle well. Two lines of research activity are sug- 
gested., In connection with the first problem, we are now convinced that 
we have reached a cul-de-sac with our present research design and 
measurement instruments. Our best strategy is not to attempt further 
large-scale, controlled experiments with before-after questionnaires 
(i.e., tests external to the actual game experience) until we have carried 
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out a number of small game sessions, over a longer period of time. 

During these sessions we would observe, tape portions of playing sessions, 
and use the actual sequence of players' decisions and actions as data on the 
learning process.* (This kind of systematic recording of game sessions 
has more general relevance than just improving evaluation of simulations. 
That is, it will also contribute to the larger problem of measuring class- 
room behavior and dynamics, an area which is still underdeveloped.) 

In connection with supplementing the game materials, during the past 
few months we have rewritten teachers’ manuals for Life Career and one of 
our other games (Consumer), so that group discussion, readings, and other 
reinforcing activities are presented as part of the game "unit." For 
example, in each manual there is a section listing relevant discussion 
questions, with suggestions on when to use them and how to handle dis- 
cussion with different types of students. 

Another kind of supplementary material is being explored in connection 
with the programmed teaching device developed by Catherine Garvey, another 
associate of the Research and Development Center. While her work has been 
in linguistic instruction, we are currently exploring the possibility of 
using this device in conjunction with various levels of the Democracy game. 
It would assist in giving players short drills in the content of the issues 
used in the game. Using the audio component can allow students practice in 
strategies of parliamentary procedure. Both procedures will raise a player' 



* As an example of this type of research, Gerald Zaltman related the 
degree of game-learning to the players' style of participation in 
the game. In his study of the Consumer game, he found that players’ 
knowledge about creditors was a function of their degree of borrowing 
during the game. "Degree of Participation and Learning in a Consumer 
Economics Game," forthcoming in Simulation Games in Learning , Sarane 
S. Boocock and E. 0. Schild, editors. 



80 




chances of performing well in the game. 

Finally, it is clear that we need to do extensive preparation of 
most teachers before we can expect them to handle most simulation games 
correctly and without anxiety. As in the case of any other innovative 
teaching technique, adequate preparation requires more than just learning 
the rules of a given game. If a teacher is to use a simulation game in 
the manner intended, he must not only familiarize himself with the equip- 
ment and the rules, hut also change his perception of the students in some 
rather basic respects. E.g., an important assumption underlying the 
technique is that stude^ 4, . can be autonomous, self -motivating, and self- 
regulating with regard to their own learning to a much greater extent 
than is nor mal ly assumed — and allowed. Because the rules are in the 
game itself, rather than being imposed by the teacher's authority, and 
because the outcome of the game, not the teacher, decides the winner, 
control of the class shifts from the teacher to the learning materials 
themselves -- and in a sense ultimately to the students. While this 
shift in control could lead to a more productive exchange between students 
and teachers, it could also be very threatening to those (both teachers 
and students) accustomed to more authoritarian methods of teaching. 

Among our activities oriented toward more effective teacher training 
is a three- session workshop to be conducted by members of our staff at 
the National Council for the Social Studies annual meetings in Seattle 
(November 24-25, 1967) . We are trying some new approaches in this work- 
shop (in addition to having a longer period of training time than usual). 
For example, rather than giving the usual introductory lecture on the 
philosophy and nature of simulation as a technique, we are opening with 
a playing session, so that all following discussions and lectures (and. 
observation of student playing sessions) will be based upon actual (and 
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common) experience of the workshop participants. In other words , we 
are trying to put into practice in the workshop some of the principles 
of gaming that we claim are its most significant components. 

In conclusion, this research has led us to shift our interests ffom 
the pragmatic question as to whether games induce learning to the more 
basic one of how learning occurs. Games are not only useful educational 
devices, but also techniques for studying the educational process itself. 
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THE JOHNS HOPKINS UNIVERSITY 
DEPARTMENT OF SOCIAL RELATIONS 

This questionnaire is the final part of an experiment being 
conducted by the Department of Social Relations at Johns Hopkins 
University. 

Your answers will be considered strictly confidential . These 
questionnaires will be taken directly to Johns Hopkins, and nobody 
but the researchers in the Social Relations Department will see them. 
Thus you can answer freely, in perfect confidence that nobody who knows 
you will see your questionnaire* 

Please answer every question. It may be hard to make up your 
mind about some of the questions — even so, please answer, and do not 
skip any question* 

Some of you filled out questionnaires at the beginning of the 
experiment* Don't worry about how you answered them — just answer 
each of these questions the way you feel today. 

Thank you for helping us in this research. 



YOUR NAME 



On each of the following. .pages you will find a word on the 
top of the page, and below the word a series of scales like this: 

HOUSE 

big / / // // // small 

Go through the scales, and show by a check mark on each how you feel when 
you think of the word at the top. For example, if you think of something very * 
big when you hear of a "house", you should check 

big L-^L-L L L L L L / sma11 

If you think of something neither big nor small but in between, you should 
check 

L L / / S ! / / L 

Or, if you think of something slightly more 'small" than "big", you should 
check 

/ 1111 -/ 1 / / 

Work rapidly don’t think too much about each scale, but .lust check what first 
comes to your mind . Please check all scales, even if they don't seem’ 



appropriate. 
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DO YOU AGREE OR D3SA(205E WITH THE FOLDOWING STATEMENTS: 

1. It is almost impossible to plan your life in advance, because so 
much depends on luck or chance. 

I agree strongly. 

__ _____ I agree. 

I disagree . 

I disagree strongly. 

2. The decisions you make right now may have a big effect on your life 
in later years. 

_____ __ I agree strongly. 

I agree. 

I disagree. 

I disagree strongly. 

3. You don't need money or education in order to enjoy free time. 

I agree strongly. 

i 

______ I agree. 

______ I disagree . 

r 

______ I disagree strongly. 

4 . You can't get a satisfactory job these days without having a college 
education. 

I agree strongly. 

______ I agree . 

I disagree . 

I disagree strongly. 




5. -The kind of person you will marry depends on how much education 
and which occupation you will have when you marry. 

I agree strongly. 

_____ I agree. 

_______ I disagree 

I disagree strongly. 

6 Having children means that a person has less time and money to 
spend on other things. 

A 

I agree strongly. 

I agree 
I disagree 

______ I disagree strongly 

7. The more education a person has, the more likely it is that his 
marriage will end in divorce. 

______ X agree strongly. 

I agree 

_____ I disagree 
I disagree strongly. 



8 . 



An oeeui»tie» which offers-a- good- ^oh^ today -will-.- also do so in 
20 years'. V 



I agree strongly 
I agree. 

I disagree 
I disagree .strongly . 
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9 , Most jobs at the same income level have the same requirements. 

I agree strongly. 

_______ I agree. 

I ' disagree . 

X disagree strongly 

10. Who can expect to get further education after high sehool? 
Only those who have very good grades in high school. 

Only those whose parents have plenty of money 

Almost anyone who really wants it can get some education 
after high school. 

_______ I don’t know. 

11. Which of the following schools is the most expensive ? 

______ State University 

Community College 

Private Liberal Arts School 

Trade School 

______ Business or Secretarial School 

All About the Same 

Bon’t Know 




u 






12. Which of the following schools requires the highest grades t© get 
in? 

State University 

_____ Community College 
____ Private liberal Arts School 
_____ Trade School 

Business or Secretarial School 
All About the Same 
Don't Know 



13. Is there any kind of further education a person can get if he or 
she hasn't graduated from high school? 

_____ no 

yes 



If you checked yes, which kind of education? 



NOW WE WILL DESCRIBE A PERSON TO YOU AND ASK YOU SOME QUESTIONS ABOUT 

HIS FUTURE AS YOU SEE IT 



Automobiles and good clothes are important in Tom's life. He is a good 
looking boy. Tom is almost 17 years old, and much sought after by both oys 
and girls. His gang is composed of boys who, like himself, do not like 
school and who have been in some minor trouble with the police. 

Tom's main pleasure in school is annoying his teachers, and he has spent 
many class periods in the principal’s office. In the required social studies 
class, he would not listen to the teacher and either pretended to be asleep 
or read books in an obviously defiant manner. He failed this course, and on y 
the combined efforts of his parents, the principal, and his counselor kept 
him from dropping out of school. 



Last year (10th grade) Tom did find one teacher — an art teacher — who 
seemed to understand him- He liked the informality of art class and the 
activities in this class so much that he has elected another art class this 

year. 



Actually, Tom probably could do much better in school than his report 
cards indicate. His scores on intelligence tests show that he has at least 
average ability in all areas. However, he is pretty much down on adults in 
general, and he feels that teachers are people who flunk students, fuss about 
unimportant things like homework, credits and grades, but who know nothing 
about such important things as driving a car, drinking beer, going hun ing, 
and being a sharp dresser. 



Tom's father owns a pretty successful trucking company. A trucker s 
life appeals to Tom, and his father has encouraged these feelings He lets 
Tom drive when one of the truckers is sick, and consequently Tom missed 25 
days of school last year. 



Tom's father attended school for only 7 years, but he encouraged Tom, 
his eldest son, to finish high school and go on to college. (He didn t, 
however, require Tom to attend school regularly or show any real concern over 
his son’s good grades.) An older sister left school before gradua on o 
marry, and two 'brothers, age 7 and 12, are In school, .His mother is a hig 
school graduate, but she shows little concern over Tom s school difricu t 
and she covers up for him when there are unexplained absences from school. 



QUESTIONS l4 • 24 ARE ALU ABOUT TOM. 



14. What do you think Tom should do next year? 

Leave school and geu a full-time job (What kind of job? 

' ) * 

Leave sehool and enlist in the Armed Forces 

Stay in 3Chool and do pretty much the same he did this 
year 

Stay in school; but take different courses (What kind of 
' courses?). — 



Go to another kind of school (Which? ) . 



Something else (What?). 



15. If Tom gets married; what kind of girl do you think he will marr^? 
First — how old will she be? 

Same age as Tom. 

A little younger 

A lot younger. j 

A little older • i 

■ I 

» 

A lot older. I 










16. How much education will she have? 

The same amount as Tom 



Less than Tom 



More than Tom 



17. Will she he working? 



Yes 



No 



18. At what age do you think Tom ought to get married? 



19 *. How many children would it be best for him to have? 



20. Which occupation do you think would be best for Tom? 



21. And what would be second best? 



tod 






22 . How much free time a week do you think would be best for Tom? 
5 hours or less 

6-8 hours 

9-11 hours 

12 - 14 hours 

15 - 17 hours 

18 and more 

23. In what area of life do you think Tom will find his greatest 
satisfaction? 

In his job 

In his family life 

In his leisure activities 

In his education 

Equally in them all 

24. And in what area do you think he will find least satisfaction? 
In his job 

In his family life 

In his leisure activities 

! In his education 

E iUally in them all 
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THE FOLLOWING QUESTIONS ARE ABOUT THE KINDS OF THINGS THAT HAPPEN IN A 

LEGISLATIVE BODY LIKE CONGRESS. 



Two Congressmen were discussing how they worked. Congressman JONES 
explained: "I study each hill as if it were the only one brought up in 

Congress, and decide (according to my convictions as well as my constituents' 
interests) how to vote on this bill. I would never agree to political 
'deals.'" 

Congressman SMITH, on the other hand, said, "On some bills I do as 
Congressman JONES does. But on others I trade my vote to other Congressmen 
in return for their support." 



25. How do you think most Congressmen actually behave ? 

Like Congressman JONES 

Like Congressman SMITH 

26. How do you feel Congressmen ought to behave ? 

Like Congressman JONES 

Like Congressman SMITH 

27. Consider again Congressman JONES . What do you think actually 
influences his decision the most: 

His own convictions 

The interests of his constituents 

Both equally 
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28. What do you feel ought to influence his decision the most? 

His own convictions 

The interests of his constituents 



Both equally j 

i 

t 

2Q. Consider again Congressman SMITH . Or what issues do you think he 
will trade his vote, rather than decide on the merits of the issue? 



30. Do you think the order in which bills are brought to the floor 
has any effect on which get passed and which get defeated? 

The order is very important 

The order is somewhat important 

The order is unimportant 

















31 . 



If a Congressman is very interested in having a bill passed, 
think he would like to have it brought to the floor early or 



do you 
late ? 



Early 

Late 

It doesn’t matter 



32. Sometimes a bill can be proposed in Congress but is never brought 
to a final vote on the floor. In which ways can one keep a bill 

from being voted on? 






33. Sometimes politics and government seem so complicated that a person 
like me can't really understand what's going on. 



I agree strongly 
I agree 
I disagree 
I disagree strongly 
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34. People like me have no say about what the government does. 

______ I agree strongly. 

I agree 

1 disagree 

_____ I disagree strongly 

35 • Somebody once said, "The most successful legislator is the one who 
always breaks his promises." Do you agree? 

_____ I agree strongly 

I agree 

I disagree 

I disagree strongly 



PLEASE EXPLAIN YOUR ANSWER TO QUESTION 35. 
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DO YOU AGREE OR DISAGREE WITH THE FOLLOWING STATEMENTS: 

36. Good luck is more important than hard work for success. 

_____ I agree strongly. 

I agree 

I disagree. 

I disagree strongly 

37. Every time I try to get e.head, something or somebody stops me. 

I agree strongly. 

I agree . 

I disagree . 

I disagree strongly. 

38. If a person is not successful in life, it is his own fault. 
I agree strongly. 

I agree , 

I disagree . 

I disagree strongly. 



39. People like me don't have much of a chance to he successful in life 
_____ I agree strongly. 

I agree . 

I disagree. 

I disagree strongly. 
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DO YOU AGREE OR DISAGREE WITH THE FOLLOWING STATEMENTS : 

40. People who accept their condition in life are happier than those who try 
to change things. 

I agree strongly. 

I agree 

I disagree. 

____ I disagree strongly. 

41. Even with a good education. I'll have a hard time getting the right kind 
of job. 

I agree strongly. 

I agree . 

I disagree. 

I disagree strongly. 

THERE ARE NO RIGHT OR WRONG ANSWERS TO THE FOLLOWING QUESTIONS' CHOOSE THE 
ANSWER THAT BEST DESCRIBES HOW YOU FEEL . 

42. When you do well on a test at school, is it more likely to be 
because you studied for it, or 

because the test was especially easy? 

43. When you have trouble understanding something in school, is it usually 
_____ because the teacher didn't explain it clearly, or 

because you didn’t listen carefully? 

44. Suppose your parents say yoU are doing well in school. Is this likely 
to happen 
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because your school work is good, or 
because they are in a good mood? 



THERE ARE NO RIGHT OR WRONG ANSWERS TO THE FOLLOWING QUESTIONS j CHOOSE THE 
ANSWER THAT BEST DESCRIBES HOW YOU FEEL . 

45. Suppose you did better than usual in a subject at school. Would it 
probably happen 

because you tried harder, or 

because someone helped you? 

46. When you lose at a game of cards or checkers, does it usually happen 
_____ because the other player is good at the game, or 

because you don’t play well? 

47. If you solve a puzzle quickly, is it 

because it wasn't a very hard puzzle, or 

because you worked on it carefully? 

48. Suppose you study to become a teacher, scientist, or doctor and you 
fail. Do you think this would happen 

because you didn't work hard enough, or 

because you needed some help, and other people didn't give it 

to you? 

49 . When you learn something quickly in school, is it usually 
because you paid close attention, or 

because the teacher explained it clearly? 

50 . When you find it hard to work arithmetic or math problems at school, 
is it 

because you didn't study well enough before you tried them, or 

because the teacher gave problems that were too hard? 



THERE ARE NO RIGHT OR WRONG ANSWERS TO THE FOLLOWING QUESTIONS. CHOOSE THE 
ANSWER THAT BEST DESCRIBES HOW YOU FEEL . 

51. When you forget something you heard in class, is it 

because the teacher didn't explain it very well, or 

because you didn't try very hard to remember? 

52. Suppose you weren't sure about the answer to a question your teacher 
asked you, but your answer turned out to be right. Is it likely to happen 

because she wasn't as particular as usual, or 

t 

because you gave the best answer you could think of? 

53 When you don't do well on a test at school, is it 

because the test was especially hard, or 

because you didn't study for it? 

54. When you win at a game of cards or checkers, does it happen 

because you play real well, or ♦ 

because the other person doesn't play well? 

55* Suppose you don't do as well as usual in a subject at school. Would this 
probably happen 

_______ because you weren't as careful as usual, or 

because somebody bothered you and kept you from working? 

56 Suppose you became a famous teacher, scientist or doctor. Do you think 
this would happen 

because other people helped you when you needed it, or 

_____ because you worked very hard? 
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THERE ARE NO RIGHT OR WRONG ANSWERS TO THE FOLLOWING QUESTIONS : CHOOSE THE 
ANSWER THAT BEST DESCRIBES HOW YOU FEEL . 

57* Suppose your parents say you aren’t doing well in your school work. Is 
this likely to happen more 

________ because your work isn’t very good, or 

__ > _____ because they are feeeling cranky? 

58. Suppose you, are showing a friend how to play a game and he has trouble 
with it. Would that happen 

because he wasn't able to understand how to play, or 

________ because you couldn't explain it well? 

59 . When you find it easy to work arithmetic or math problems at school, is 
it usually 

________ because the teacher gave you especially easy problems, or 

because you studied your book well before you tried them? 

60 • When you remember something you heard in class, is it usually 

because you tried hard to remember, or 

_______ because the teacher explained it well? 

6 1. If you can't work a puzzle, is it more likely to happen 

because you are not especially good at working puzzles, or 

____^ because the instructions weren't written clearly enough? 

62. Suppose you are explaining how to play a game to a friend and he learns 
quickly. Would that happen more often 



because you explained it well, or 
because he was able to understand it? 



THERE ARE NO RIGHT OR WRONG ANSWERS TO THE FOLLOWING QUESTIONS J CHOOSE 
THE ANSWER THAT BEST DESCRIBES HCW YOU FEEL . 

63. Suppose you’re not sure about the answer to a question your teacher 
asks you and the answer you give turns out to be wrong. Is it likely 

to happen 

because she was more particular than usual, or 
because you answered too quickly? 

64. How old are you? years 

65. Sexs Male 

Female 



66, Do you live with . both parents 

father only 

______ mother only 

_____ neither 

67. What is your father's (guardian's) occupation? 



60. What is your mother's occupation? 



69. How far in school did your father go? 



^___ None, or some grade school 
_______ Completed grade school 

Some high school, but did not graduate 

______ Graduated from high school 

Technical or business school after high school 

Some college but less than 4 years 

Graduated from a 4 year college 

Attended graduate or professional school 

______ Don't know 

70. How far in school did your mother go? 

None, or some grade school 
Completed grade school 

Some high school, but did not graduate 

_____ Graduated from high school 

Technical, nursing, or business school after high school 

Some college but less than 4 years 

Graduated from a 4 year college 
Attended graduate or professional school 
Don't know 
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Appendix B: Measurement of Sense of Control 

Given that sense of control was the major focus of the original 
design, two approaches to measuring the concept were included on the 
questionnaire . One is a set of attitude items taken from the Coleman 
report on educational opportunity. The other set of items were taken 
from a set composing the I (for internality) scale developed by Crandall 
et al. The contents of the scales are quite different. 

Several of the Coleman items refer to the environment as being 
capricious, with any achievement being a matter of luck. Others at- 
tribute failure to some deficiency in the individual. On the other 
hand, the Crandall items were developed explicitly to omit that part 
of lack of belief in control attributable to fatalism. Instead, the 
scale was developed to deal exclusively with control in intellectual- 
achievement situations. The source of external control in the situa- 
tions described in the items is some adult, not fate or "somebody else." 
The Coleman items seem to tap some generalized fatalism with respect 
to one's life chances. 

The Crandall items form two subscales. The 1+ scale consists 
of those ite ms which refer to control over one's successes; the I- 
scale consists of items which refer to control over failure. The 
subscales have not been found to be highly related, although the re- 
lationship becomes greater with age of the subjects. Our data cor- 
roborate this finding. The product -moment correlation for pre-test 
I scores is -.28. The scales have shown to be highly reliable, by 
several methods. There is no reliability data on the Coleman items. 

The I scores have been shown to be moderately related to IQ, and 
Class, as have the Coleman items.,. They have similarly been related 
to achievement, although the data are ambiguous because the relation- 



ships are specified by the age and sex of respondents. (For example, 
one of the studies shows that the scores predict academic achievement 
for younger girls and high school age boys, but not young boys and 
high school age girls.) The developers claim the instrument to be 
most effective as a predictor of report-card grades. The Coleman 
items have been shown to be important for predicting educational 
achievement among minority groups in particular. (There is no mention 
of race in the I score studies.) 

On face value both scales do what they purport and clearly obtain 
information concerning the respondents’ sense of control over success 
and failure. The same background variables differentiate the re- 
spondents as to degree of control expressed. Both scales have shown 
to be predictors of achievement, though of different sorts. How well 
are they interrelated, or, to what extent are they concerned with 
different types of control? 

The answer is quickly eviderit — there is not much relationship. 
The correlation for pre-test 1+ and Coleman scale scores is .11; for 
I- and Coleman scales it is . 00 . Table B-l elucidates the lack of 
relationship. Intercorrelations are presented for the six Coleman 
items separately and the I scores. Several trends are notable. First 
the Coleman items themselves are at best only moderately related to 
one another. One cluster does appear among items 36 , 37 j 39 > 4l. 

Items 38 and 40 are each independent of all other items. Secondly, 
the I scores are not much related to the Coleman items, except to 39* 



TABLE B-l. Control Item Intercorrelation Matrix 
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Appendix C: Test Effects 



Premeasures may affect the final results in that they arouse subject's 
interest in the topic at hand or provide experience with the relevant task. 
One procedure for reducing interest is to include non-relevant items randomly 
assorted among relevant items on the pre-test. This was not done in the 
present study. There is, however, one rough guide for guaging the amount 
of premeasure effect which did occur. 

At Schools A and C sets of experimental and control groups received 
the posttest only. Presuming that the premeasure scores for these to have 
been comparable to the other groups within each school, then we can examine 
the posttest responses for signs of premeasure effects.* If an item shows 
much greater rate of correct response at the school with the premeasure, 
then we are led to suspect that some measurement effect has occurred. 
Fortunately, these effects do not appear to have influenced the results 
greatly in our study. 

In Table C-l the percentage who respond knowledgeably to posttest 
career items are presented. For only one item, 6, does there appear 
to have been a pre-test effect across both schools and treatment groups. 

For School C alone, there appears also to have been greater likelihood 
to respond correctly for the pre-test groups on items 5* 10, and 11. 

The legislature items appear even less affected by premeasure ex- 
perience. For none of the responses to the seven items composing the 
scale is there a clear premeasure effect across both schools and treatment 
groups. (See Table C-2.) Again, on several items (21, 25* 32) there 
are indications of some effect at School C. 

* Again, we should remind the reader that subjects were not randomized 
into groups; hence the assumption is not easily made. 



TABLE C-l. Per Cent Who Respond Knowledgeably To Post-Test Career Questions 
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TABLE C-2. Per Cent Who Kespond Knowledgeably To Post-Test Legislature Questions 
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Finally, with regard to the items tapping sense of control, data 
in Table C-3 show that there is little indication of premeasure influence. 
Effect is less expected in items of this sorb, self-report information, 
in contrast to some of the very specific knowledge items. 

In general, the premeasure effects which may have occurred do noj; % 

' » 

appear frequently enough to account for the greater learning at School 
C. Eliminating the questionable items, the results follow the same trend 
discussed in the main text; the experimental and control groups at School 
C have greater posttest knowledge than those at School A. Within the 
schools there is no difference between those exposed to the games and 
those given the conventional classroom techniques. 

Parenthetically, it is particularly regrettable that posttest - 
only groups co ul d not be obtained for School B. If so, the data would 
have assisted in deciding to what extent the successful learning in the 
control group at B may have been the result of premeasure effect. 

Finally, the lack of variation in results between comparable pre- 
test and posttest-only groups further supports our contention that teacher 
effectiveness is not the most adequate explanation for cross-school dif- 
ferences in learning. The teacher of the posttest-only group at School A 
was as of limited success as the other teacher at School A. Similarly, 
the students at School C in the posttest-only groups were as knowledgeable 
(eliminating test-effect items) as the pre-test students. The likelihood 
that we had two less effective teachers at School A or two very effective 
teachers at School C does not appear great, given the trends in the data. 






TABLE C-3. Per Cent Who Respond With Sense of Control On Post 
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